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ABSTEACT 

This  report  describes  an  evaluation  of  Project 
Inforeaation  Packages  (PIPs)  ,  sets  of  manuals  and  other  materials 
intended  to  help  a  school  district  adopt  and  implement  an  exemplary 
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describing  a  different  bilinaual  project.  It  vas  concluded  that  the 
awareness  materials  produced  few  applications  for  PIPs,  Field-test 
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bilingual  programs  at  the  sites  were  collectively  successful,  but  the 
dissemination  effort  could  not  be  judged  a  success.  The  present 
volume  docrments  the  methodology  and  results  of  the  process  and 
impact  substudies  and  provides  detailed  discussions  of  conclusions 
and  recommddations.  Five  appendices  are  attached;    (1)  site-fcy-site 
results  of  the  process  substudy,   (2)  site*by-site  results  of  the 
impact  substudy^   (3)  the  complete  conceptual  framework  used  in  the 
process  evaluation  substudy^   (4)  a  comparative  analysis  of  the 
contents  of  the  four  bilingual  PIPs,  and  (5)  a  summary  of  th€  major 
mid*study  inputs  fro^  the  study  advisory  panel,  (Author) 
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PREFACE 

This  report  deBcribes  an  evaluation  of  Project' Informacion  Packages 
(PIPb}»  a  specific  type  of  packaging^  as  field  Cesfied  by  the  United  States 
Office  of  Education  (USOE)  for  the  diffusion  of  four  bilingual  projects* 
The  field  test  began  with  the  dissemination  of  the  PIPs  in  the  fall  of 
1976*    The  evaluation  described  here  began  sbout  nine  loonths  later  (sutomer^ 
1977}  and  continued  through  the  1978*1979  school  year* 

This  report  consists  of  three  volumes^  as  follows: 

Volume  Ij  the  Summary  Report*  comprises  (a)  an  executive  suramary  of 
the  study  questions  and  findings^  (b)  an  introduction  to  the  study  (Sec^ 
tion  l)t  (c)  a  non-technical  summary  of  Substudy       the  process  evaluation 
of  the  PIP  diffusion  effort  (Section  2)*  and  (d)  a  non-technical  summary 
of  Substudy  11^  the  evaluation  of  the  impact  of  the  diffusion  effort  on 
students  (Section  3)*    This  volume  is  intended  to  provide  a  self'^^contalned 
overview  of  the  policy-related  study  questions  and  conclusions* 

Volume  II,  the  present  volume ^  documents  the  methodology  snd  results 
of  the  two  substudies  and  provides  more  detailed  discussions  of  conclu- 
sions and  recommendations*    This  volume  also  includes  five  appendices: 
(a)  site-by-site  results  of  the  process  substudy^  (b)  site-by*site  results 
of  the  impact  substudy^  (c)  the  complete  conceptual  framework  used  in  the 
process  evaluation  substudy^  (d)  a  comparative  analysis  of  the  contents 
of  the  four  bilingual  PIPs»  and  (e)  a  summary  of  the  rnajor^  mid-study 
inputs  from  the  study  advisory  panel* 

It  is  assumed  that  the  reader  will  read  Volume  I  as  an  introduction 
to  Volume  II*    Volume  II  is  not  intended  to  stand  alone^  and  the  sections 
of  the  report  are  numbered  consecutively  across  the  two  volumes^  with 
Sections  1*3  included  in  Volume  I  and  Sections  4^13»  plus  Appendices  A-E» 
included  in  Volume  II* 


Volume  la  a  collection  of  specific  evaluation  guidelines  and  job 

aides  that  were  developed  for  the  use  of  the  field*test  sites  and  wh^ch 
have  been  organized  ±n  the  format  of  a  Prototype  Evaiuatioti  Manuals  This 
Volume  should  be  viewed  as  a  preliminary  draft  rather  than  a  finished  pro- 
duct*    Further*  it  deals  in  detail  only  with  the  evaluation  of  student 
acuievement,  which  is  only  one  component  of  a  complete*  bilingual  program 
evaluation* 


iv 


TABLE  OF  CONTENTS* 


Page 

LIST  OF  TABLES   xl 

LIST  OF  FIGURES   xl 

SUBSTUDY  I:    DIFFUSION  OF  THE  PROJECTS 

4.  INTRODUCTION  TO  SUBSTODY  I:    DIFFUSION  OF  THE  PROJECTS.  .  .  63 

4.1  USOE  Study  Objectives   63 

4.1.1  Process  Evaluation  Requirements  ........  63 

4.1.2  Impact  Evaluation  Requirements   65 

4.1.3  PIP  Dissemination  Recommendations   65 

4.2  Specific  Working  Questions    66 

5.  SUBSTUDY  I:    TECHNICAL  APPROACH   69 

5.1  Introduction   69 

5.2  Conceptual  Framework  for  Intended  and  Actual  Dif- 

fusion System  Models    71 

5.2.1  Rationale  end  Definitions   71 

5.2.2  Descriptive  Conventions  for  Components, 

Processes,  and  Outcomes    72 

5.2.3  Conventions  for  Organizing  Components, 

Processes,  and  Outcomes  into  a  Model.  «...  77 

5.2.4  Using  the, Descriptive  Conventions  to  Develop 

a  System  Model   81 

5.2.5  Project  Models  and  Other  Special  Summaries.  .  .  83 

5.3  Using  the  Models  for  Process  Analyses   84 

5.3.1  Comparing  Project  Models   84 

1.3.2  Identifying  Diffusion  System  Problems    86 

5.3.3  Determining  Causes  of  Problems   87 

5.3.4  Reversing  the  Direction  of  the  Analysis  ....  87 

5.3.5  Developing  Problem  Themes   88 

5.3.6  Using  the  Models  for  Planning  and  Revision.  .  .  89 


*See  Volume  I  for  Sections  1*3. 

V 

c 


TABLE  OF  CONTENTS  (continued) 

Page 

6.  METHODOLOGY   91 

6*1    Instrument  Development   91 

6.1.1  Level  of  Detail  for  Data  Needs   91 

6.1.2  Individualized  Interview  Guides    91 

6.1.3  Classroom  Observation  Guldea   94 

6.2    Data  Collection  and  Processing   95 

6.2.1  Data  Collection   95 

6.2.2  Data  Processing   98 

7.  SUBSTUDY  I:    ANALYSIS  AND  RESULTS   101 

7.1  Introduction   101 

7.1.1  Overview  of  Results   101 

7.1.2  Organization  of  the  Analysis  and  Reaults 

Section   102 

7.2  Stage  0:    Initial  Conditions    103 

7.2.1  Overview   103 

7.2.2  USOE  Initial  Conditions   105 

7.2.3  Initial  Conditions  of  Dlffusers    107 

7.2.4  Initial  Conditions  In  Target  LEAs   108 

7.2.5  SumiQary  of  Status  and  Problems:  Initial 

Conditions   118 

7.3  Stage  1:    Preparation   120 

7.3.1  Overview   120 

7.3.2  USOE  Preparation   120 

7.3.3  Preparation  of  Dlffusers   122 

7.3.4  Preparation  of  Target  LEA  Components   125 

7.3.5  Suimnary  of  Progress  and  Problema:    Preparation.  132 

7.4  Stage  2:    Selection/Adoption   134 

7.4.1  Overview   134 

7.4.2  Selection/Adoption  Activities  Affecting  USOE.  .  135 

7.4.3  Selection/Adoption  Activities  Affecting 

Dlffusers   137 


vl 

7 


TABLE  OF  COHTENTS  (continued) 

Page 

7.4.4  Selection/Adoption  Activities  Affecting 

Target  LEAs   138 

7.4.5  Summary  of  Progress  and  Problems:  Selection/ 

Adoption   144 

7.5  Stage  3:    Start^Up   146 

7.5.1  Overview   146 

7.5.2  Stsrt-Up  Activities , Affecting  USOB   147 

7.5.3  Start-Up  Activities  Affecting  Dlffusers  ....  150 

7.5.4  Start^Up  Activities  Affecting  Target  LEAs  ...  150 

7.5.5  Summary  of  Progress  and  Problems:    Start-Up  .  .  156 

7.6  Stage  4:    Operation   159 

7.6.1  Overview   159 

7.6.2  Activities  Affecting  USOE  During  Operation.  .  .  160 

7.6.3  Activities  Affecting  Dlffusers  During 

Operation   160 

7.6.4  Activities  Affecting  Target  LEAs  During 

Operation   160 

7.6.5  Summary  of  Progress  and  Problems:    Operstlon.  .  170 

7.7  Stimmsry  of  Project-Model  Comparisons   172 

7.7.1  Developer-Slte  Projects  Versus  PIP-Descrlbed 

Projects.   172 

7.7.2  Developer-Slte  Projects  Versus  Fleld^Test* 

Site  Initial  Conditions    172 

7.7.3  Developer-Slte  Projects  Versus  Field-Test* 

Site  Operations   172 

7.7.4  PIP-Descrlbed  Projects  Versus  Field-Test- 

Site  Initial  Conditions    172 

7.7.5  PIP-Descrlbed  Projects  Versus  Fleld-Test- 

Slte  Operation   173 

7.7.6  Tryout-Slte  Initial  Conditions  Versus  Tryout- 

Slte  Operation   173 

7.7.7  Wlthln^Cell  Project-Model  Comparisons    173 

8.    DISCUSSION  ADD  RECOMMENDATIONS   175 

8.1    Discussion  of  Key  Diffusion  Problems   175 

8.1.1  Diffusion-System  Goals   175 

8.1.2  PIP  Projects.  .  r   177 


vll 

C 


TABLE  OF  CONTENTS  (continued) 


8.1.3  Target  LEAs   

8.1.4  Delivery  System   

8.1.5  Incentives  to  Replicate   

8.1.6  Competing  Influences  

8.2  Answera  to  the  Specific^  Working  Queatlona  from 

Section  4.2  

8.2.1  Adoption  

8.2.2  Implementation  

8.3  PIP  Revisions  Veraus  Alternative  Substudy  I 

Products   

8.3.1  PIP  Revision  <,  .  .  . 

8.3.2  Alteraatlvftt  Substudy  I  Producta  

8.4  Synopsis  of  Recommendations  from  Subatudy  I.  .  . 

8.4.1  General  Recommendations  for  ?titure  Diffu- 

sion Efforta  

8.4.2  Goal-Specific  Recommendatlona   


SUBSTUDY  II:    IMPACT  ON  STUDENTS 
INTRODUCTION  TO  SUBSTUDY  II*    IMPACT  ON  STUDENTS 

9.1  Scope  of  Substudy  II   

9.1.1  Subatudy  II  Objectives  

9.1.2  Specific  Impact-Substudy  Queatlons. 

9.2  The  BMC  Role  In  the  Impact  Substudy.  .  .  . 

9.3  Organization  of  the  Substudy  II  Report  .  . 


TECHNICAL  ISSUES  IN  THE  EVALUATION  OF  STUDENT  ACHIEVEMENT 
IMPACTS  

10.1  "Impact"  Versua  "Performance  Level"  Evaluation  .  .  .  • 

10.2  '^Apparent"  Veraus  "Actual"  Impacts  of  Exemplary 

Programs   


viii  9 


TABLE  OF  CONTENTS  (continued) 


10.3  Clarification  of  the  Impact*Evaluatlon  Questions  .  .  . 

10.3.1^  .Dejeinlng  the  Skill  Areas  of  Interest  

10.3.2    Obtaining  Comparison  Standards   

10.4  practical  Problems  In  Answering  the  Substudy  II 

Questions  *  

10.4^1    problems  Deriving  from  the  Pleld*-Test 

Design   

10.4.2    Problems  Typical  of  Local  Program  Evalu- 
ations   


11.    EVALUATION  OP  ACHIEVEMENT  IMPACTS:    PROCEOUKES  AND 

BESULTS   

11. 1  Substudy  II:    Year  One  

11.1.1  Plrot-Year  BMC  Activities   

11.1.2  RMC  Impacts  on  Field- Test^Slte  Valuations.  . 

11.1.3  Synopsis  of  First-Year  Evaluations  

11.2  Substud    II:    Year  Two  

11.2.1  Preliminary  Review  of  Achievement  Impact 

Results   

11.2.2  Development  of  Credibility  Rating  Procedures. 

11.2.3  Application  of  the  Credibility  Rating  Scales. 

11*2.4    Discussion  of  Credibility  Results   

11.2.5   The  Quality  of  Local  Evaluation  Reports  .  .  . 


12*    EVALUATION  OP  OTHER  IMPACTS  

12.1  Introduction  '  .  .  . 

12.2  Evaluation  of  i^ffectlve  Impscts  

12.2.1  Technical  Issues  

12.2.2  Affective  Evaluation  Methods  

12.3  Evaluation  of  Staff  Development   

12.3.1.  Technical  Isaues  

12.3.2    Staff*-Development  Evaluation  Methods  


ix 


TABLE  OF  CONTENTS  (continued) 


Page 


12*4    Evaluation  of  Parent/Community  Involvement   253 

12*4.1    Technical  Isaues   253 

12.4.2    Parent /Community  Evaluation  Hetboda    254 

13.    CONCLUSIONS,  RECOMMENDATIONS,  AND  PRODUCTS  FROM  THE  IMPACT 

SUBSTUDY   257 

13*1    Apparent  Impact  as  a  Criterion  for  Selecting 

Exemplary  Frojecta   257 

13.2   Achievement -Impact  Evaluation  aa  a  Meaaure  of 

Dlf fualon-Syatem  Ef fectlveneaa   259 

13*3   Broader  implications  for  Program-Evaluation  Re- 

qulrementa  and  Guidelines   260 

13*4    Subatudy  ii  Product:    A  Prellmlnary*Draf t  Evaluation 

Manual   261 

APPENDICES 

APPENDIX  A    ADOPTER*SITE  RESULTS   265 

APPENDIX  B    FIRST-YEAR  ADVISORY  PANEL  RECOMMENDATIONS   377 

APPENDIX  C    A  DETAILED  SUMMARY  AMD  COMPARISON  OF  PIp  CONTENTS.  ♦  ♦  393 

APPENDIX  D    PRE-  AND  POSTTEST  SCORES  FROM  FIELD  TEST  SITES  .  .  ♦  ♦  483 

APPENDIX  E    DIFFUSION  SYSTEM  MODEL  >   527 

REFERENCES   567 


ii 


LIST  OP  TABLES 


Tsble  Page 

1       Credibility  o£  Achievement  Impact  Ev6luatlons»  1978- 

1979,  Grade  2   236 

LIST  OF  FIGURES 

Figure  Page 

it 

6  Descriptive  Conventions  for  Dlffua Ion-System  Models  .  .  73 

7  Framework  for  the  "Intended"  PIP-Diffuslon  System 

Itodel  >   78 

8  Project**Model  Comparisons   65 

9  Actual  PIP  Diffusion  System:    Stage  0  Key  Issues.  .  .  .  104 

10  Actual  PIP  Diffusion  System:    Stage  1  Key  Issues.  ...  121 

11  Actual  PIP  Diffusion  System:    Stage  2  Key  Issues.  •  .  .  136 

12  Actual  PIP  Diffusion  System:    Stage  3  Key  Issues.  ...  148 

13  Actual  PIP  Mffuslon  System:    Stage  4  Key  Issues.  .  .  .  161 

14  General  Impact  Evaluation  Guidelines  for  PIP  Field- 

Test  Sites,  September  1978.  .  «   221 

15  BMC  Credibility  Rating  Scales  for  Achievement  Impsct 

Evaluations   232 


^Figures  1-5  are  found  In  Volume  I- 


xl 

1  O 


SUBSTUDY  I:    DIFFUSIOH  OF  THE  PROJECTS 


4.    INTRODUCTIOR  TO  SUBSTUDY  I:    DIFFUSION  OP  THE  PROJECTS 


The  suinmary  of  Substudy  I  (Section  2,  Volume  1}  describes  the  general 
focus  of  the  Substudy.    This  section  elaborates  on  tUe  USOE  study  objec- 
tives snd  the  specific  working  questions. 

4.1    USOE  Study  Objectives 

The  request  for  propossl  (RFP)  for  the  bilingual  PIP  study  listed 
four  objectives: 

I*    Determine  the  effectiveness  of  the  packaged  materials  In  assist- 
ing school  districts  to  select  atid  Implement  the  projects  they 
describe. 

2*    Determine  the  effectiveness  of  projects  implemented  via  the  PIPs 
In  Improving  student  achievement  and  attitude. 

3.    Identify  and  analyze  implementation  problems  encountered  by  the 
tryout  sites. 

4*    Revise  the  materials  on  the  basis  of  user  Input  and  the  problems 
Identified. 

4.1.1    Process  Evsluatlon  Requirements 

In  the  RFP,  Objectives  I  and  3  defined  the  process  (Substudy  I)  eval- 
ustlon  Issues.    The  ^ipeclflc  Issues,  ss  stated  In  the  RFP  were: 

4.1.1.1    Selection  and  adoption  of  projects.    For  selection  and  adop- 
tion of  projects,  the  RFP  defined  the  process  Issues  as: 

•  How  sites  were  made  aware  of  the  bilingual  PIPs  (e.g.,  what 
Information  and  assistance  wss  provided  to  adopters  by  USOE 
and  the  TRCs)- 
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•  How  effective  Che  awareness  and  planning  materials  were  for 
assisting  school  districts  In  detemdnlng  whether  or  not  to 
adopt  a  PIP  project  (l*e*,  were  the  materials  used*  did  they 
contain  sufficient  Information  for  school  districts  to  make 
an  adoption  decision,  what  additional  asslRtance/lnfonnatlon 
was  needed)* 

•  Why  sites  selected  a  PIP  project  for  Implementation* 

•  Whether  adoption  sites  were  suitable  to  Implement  the  proj-* 
ects  (l*e*»  were  the  projects  aelected  filtable  to  the  needs 
and  contexts  of  the  districts?}* 

•  What  the  extent  of  district  support  was  for  the  projects  at 
this  stage  and  how  support  was  generated* 

4*1*1*2    Start-up  and  operation  of  prolecCfl.    For  start-up  and  oper- 
ation phases »  the  RFP  required  the  contractor  to: 

•  Describe  activities  and  procedures  and  compare  with  PiP  spe- 
cifications * 

•  Determine  implementation  problems  with  and  participant  reac- 
tions to  4  .Ivltles  and  procedures  described  In  the  PIPs* 

•  Determine  the  modifications  to  the  PIP  activities  and  proce- 
dures »  and  the  effects  that  they  have* 

•  Determine  the  reasons  for  problems  and  modifications*  Con- 
sider whether: 

»  the  PIP  materials  are  Inadequate  In  some  way»  or 
—  the  assumptions  In  the  PIP  about  the  site  are  not 
warranted* 
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4*1*2    Impact  Evaluation  Requirements 


Objective  2  specified  a  summatlve  (impact  on  students)  evaluation 
(see  Substudy  XI»  Sections  9-13)* 

4*1*3    PIP  Dissemination  Recommendations 

Under  Objective  4,  the  RFP  required  that  the  contractor  generate 
recommendations  concerning  how»  If  at  all»  the  projects  should  be  dlsseml* 
nated  In  the  future  Including: 

a*    What  revisions*  If  any»  are  needed  In  the  materials*  and 

b*    The  extent  to  which  technical  assistance*  In  addition  to  the 
PIPs»  Is  needed* 

The  process  evaluation  and  dlaseminatlon  recommendations  are  the 
major  focus  of  Sections  4  through  8  of  this  report*    Sections  9  through 
13  describe  impact -evaluation  activities  and  results* 
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4*2    Specific  Working  Questions 


The  Initial  step  In  planning  Substudy  I  was  to  reorganize  the  set  of 
diffusion  substudy  questions  so  as  to  reflect  the  experience  of  previous 
dlsseirilnatlon  research* 

The  general  Substudy  I  question  was  -  What  were  the  effects  of  the 
diffusion  effort  on  LEAa?  Specifically: 

1*    Mop  t  Ion 

a*    What  Influenced  potential  adopter  sites  to  adopt  or  not 
adopt? 

b*    To  what  extent  were  the  projects  chosen  by  adopters  ap** 
proprlate  to  those  ad.'pters? 

2  *    Imp lemen  ta  1 1 on 

a*    What  factors  (context^  PIP»  and  other)  Influenced  Imple- 
mentation? 

b*    What  were  the  characteristics  of  the  resulting  programs^ 
and  how  closely  did  they  resemble  those  described  In  the 

PIPS? 

Questions  concerning  the  effects  of  the  diffusion  effort  on  the  LEAs 
are  broken  down  Into  those  relating  to  "adoption/*  and  those  relating  to 
"Implementation*"    Under  the  heading  of  "adoption"  are  Included  (a)  all  the 
awareness  activities  Involved  In  getting  Information  about  the  projects  and 
packages  to  the  school  districts^  (b)  district  review  of  the  projects^  and 
finally  (c)  the  district  decision  to  implement  a  particular  project*  Im- 
plementation refers  to  the  actual  start-up  and  operation  of  the  adopted 
project*    For  both  adoption  and  Implementation  stages^  separate  subques- 
tlons  address  the  factors  that  Influenced  the  final  results  of  these 
stages  and  the  description  of  exactly  what  the  results  of  these  stages 
were* 
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While  the  purpose  of  the  study  was  to  observe  the  effects  of  the  PIP 
diffusion  effort  as  opposed  to  diffusion  efforts  in  general,  it  was  recog- 
nized that  this  effort  was  only  one  of  many  influences  affecting  adopter- 
site  programs.    In  some  districts,  private,  state,  and  local  regulations 
and  diffusion  systems  may  have  had  more  impact  than  did  the  pip  effort. 
Therefore,  in  so  far  as  it  was  possible,  the  study  attempted  to  account 
for  other  major  impacts  on  the  adopter^'sites,  and  to  attribute  project 
characteristics  to  the  PIPs  only  where  actually  warranted.  Information 
on  complementary  or  competing  diffusion  activities  was,  of  course,  also 
relevant  to  revision  of  the  PIP  diffusion  effort. 
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5*    SUBSTUDY  I:    TECHNICAL  APPROACH 


5*1  Introduction 

The  process  evaluation  for  the  Bilingual  PIP  study  reflects  the  phi- 
losophy that  development  of  an  effective  educational  diffusion  system^  or 
any  similarly  complex  system^  is  always  an  evolutionary  process  of  plan- 
ning»  tryout^  and  revision^  with  the  sequence  repeated  until  satisfactory 
results  are  achieved*    Vhile  a  process  of  minor  adjustments  based  on  con- 
tinuing feedback  may  later  become  a  permanent  feature  of  a  system^  the 
evaluation  approach  described  here  is  designed  for  the  initial  develop-^ 
ment  stages  during  which  many  new  ideas  are  tried  and  major  revisions  are 
required* 

The  conceptual  framework  that  constitutes  the  basis  of  the  approach 
is  intended  not  only  to  document  the  activities  of  the  bilingual-PIP  field 
test»  but  also  to  integrate  the  diverse  collection  of  positive  and  nega- 
tive tryout  findings  and  serve  as  a  basis  for  revising  the  diffusion  sys- 
tem*   The  framework  derives  from  systems  analysis  principles  employed  by 
the  senior  author  in  the  early  19603  (see*  for  example*  Gagnel*  1962}* 
The  development  of  the  approach  and  the  framework  in  their  present  forms 
was  begun  by  RMC  in  the  earlier  PIP  field  tests  (Studies  2  and  6}* 

In  the  simplest  terms*  the  evaluation  approach  consists  of  (a)  de^ 
scribing  the  diffusion  system  as  it  was  intended  to  operate*  (b)  describing 
the  system  as  it  actually  operated*  (c)  comparing  the  two  descriptions  and 
analyzing  discrepancies*  and  (d)  proposing  changes  to  correct  the  problems* 
Recommended  changes  might  take  the  form  of  more  practicable  procedures  for 
meeting  the  existing  goals*  but  recommendations  may  also  include  changes  as 
in  the  goals  themselves* 

In  principle*  this  approach  is  little  more  than  common  ser\se*  In 
practice*  however*  the  many  people  and  organizations  involved  in  a  diffu^ 
sion  system*  and  the  wide  variety  of  goals*  procedures*  materials  and  so 
on  that  are  involved*  make  it  difficult  to  describe  such  a  system  in  a  way 
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that  captures  the  role^j  of  iXX  the  parts  of  the  system  and  displays  their 
interactions  clearly*    Comparing  the  actual  findings  of  a  tryout  with  the 
original  plsns  for  the  system  and  then  developing  revised  plans  that  re- 
tain the  successful  difiuciion  techniques  and  replace  the  unsuccessful  ones 
is  a  complex  technical  task* 

Xhe  key  to  the  evaluation  approach  described  here  is  the  development 
of  concise »  accurate  descriptiona  of  intended  and  sctusl  diffusion  systems* 
These  descriptiona  are  referred  to  here  as  "models*"  that  is»  abstractions 
of  reality  thai:  retain  only  those  features  that  are  relevant  to  understand* 
ing  and  revising  the  diffusion  system*    Such  models  must  be»  at  a  minimum» 
(a)  coiiq>rehenaive  in  terms  of  Important  system  festures»  (b)  unainbiguous 
enough  so  that  there  is  no  question  as  to  where  any  feature  fits  into  a 
model)  (c)  minimally  redundant  so  that  a  given  feature  need  not  be  described 
more  than  once»  and  (d)  internally  conaistent  so  that  a  single  set  of  de- 
scriptive conventions  applies  uniformly  throughout  the  description*  Mbdels 
should  also  be  as  parsimonious  as  possible  to  maximize  their  utility* 
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5.2    ConcePttjal  Framework  for  Incended  and  Accusl 
Diffusion  SYsCem  Models 

5.2.1    Rationale  and  Deflnlclons 

5.2.1.1  SYsceai  coffigonencs.    A  complete  diffusion  system  Is  made  up 
of  many  parts  (people*  materials*  guidelines*  and  so  on)  Interacting  with 
each  other.    We  will  refer  to  these  parts  as  "components"  of  a  system. 
The  kind  of  system  In  which  we  are  Interested  la  a  purposive  system.  That 
ls»  It  Is  developed  by  a  particular  group  (In  this  case»  USOE)  to  achieve 
a  particular  purpose  (implementation  of  effective  bilingual  projects). 
This  kind  of  system  can  be  viewed  as  a  sort  of  pyramid  with  the  organizing 
agency  at  the  top.    The  organizers  prepare  a  group  of  disseminators  by 
selecting,  hiring,  and  training  personnel,  and  by  providing  them  with 
appropriate  materials.    The  disseminators.  In  turn.  Inform  LEAs,  and 
provide  materials  and  training.    Finally,  the  LEA  personnel  obtain  and 
train  stsff,  develop  plans  and  eventually  tesch  students.    The  goals  of 
the  system,  of  course,  are  related  to  what  happens  to  students.  However, 
the  USOE  Impact  on  the  system  ls»  by  and  large,  retnote  from  the  classroom. 

5.2.1.2  Systena  Process  statements.    If  a  model  Is  to       useful  for 
Improving  such  a  system.  It  must  make  clear  what  the  organizers  of  the 
system  can  sctually  do  to  achieve  their  goals.    The  approach  taken  here 

Is  to  describe  the  contributions  of  each  component  to  the  system,  stsrtlng 
with  the  organizing  agency,  and  to  show  how,  singly  or  In  combination » 
various  components  ensure  thst  other  components  accomplish  their  purposes. 
The  basic  elements  from  which  we  build  up  the  system  description  are 
"process  stat^ents'*  of  the  form: 

•  Which  components? 

•  Do  what?  (When?) 

•  To  which  other  component? 
c  With  what  results? 

plus  outcome  statements  that  Indicate: 

•  With  what  results? 
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5*2*1*3    System  models*    In  principle»  a  system  model  is  developed 
by  (a)  listing  all  the  components  in  a  system*  (b)  describing  what  the 
components  are  like  before  the  system  begins  operation*  (c)  describing  all 
the  processes  operating  on  each  component*  and  (d)  describing  the  results 
of  the  processes  in  terms  of  what  the  components  are  like  after  the  pro^ 
cesses  have  operated*    For  example^  (a)  disseminators  are  listed  aa  compo- 
nents of  the  system;  (b)  the  characteristics  of  potential  disseminators 
are  described;  (c)  the  processes  by  which  USOE  personnel  select  dissemina* 
tors  from  the  pool  of  potential  disseminators  and  train  them  in  system 
procedures  is  described;  and  (d)  the  results  are  tlescribed  in  terms  of 
appropriately  trained  and  functioning  disseminators* 

In  practice^  a  model  requires  much  more  detail  than  the  above  example 
suggests*  and  with  the  added  detail  comes  a  need  fcr  careful*  systematic 
organization  of  all  the  descriptive  statements*    In  addition*  the  need  for 
parsimony  and  internal  consistency  means  that  the  statements  must  conform 
to  formally  specifier*,  conventions*    The  conventions  used  in  this  study  for 
writing  and  organizing  process  and  outcome  statements  are  summarized  in 
Figure  6  and  described  in  the  following  sections*    The  "intended"  diffu- 
sion system  model  used  in  this  study  appears  in  Appendix  £  of  this  report* 

5*2*2    Descriptive  Conventions  for  Components,  Processes*  and  Outcomes 

5*2*2*1    Categories  of  system  components*    By  ^'components"  we  mean 
all  the  tangible  things  involved  in  the  diffusion  of  projects*  Components 
include : 

•  Persons  (including  students) 

•  Other  resources  (materials^  facilities^  funds) 

•  Plans  and  constraints 

These  components  are  probably  self-explanatory  except  for  "plans  and  con- 
straints*"   We  have  found  that  it  is  helpful  to  think  of  plans  and  con^ 
straints  as  tangible  system  components  that  act  upon  other  components  and* 
in  turn*  are  acted  upon*    "Plans'^  includes  all  system  guidelines  such  as 
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System  Components  Initial  Conditions  Processes  Acting  Upon 

and  Outcomes  Components  to  Produce 

Outcomes 


Who? 

With  what  characteristics? 

Does  what? 

To  Whom? 

What  characteristics  result? 

Personnel 

USOE 

Goals/attitudes 

Select 

OBE 

Skills/knowledge 

Train/Inform 

OPBE 

Roles/ iBkdge 

Elicit 

SEA 

Availability 

Allocate 

Dlffusers 

Target  LEA 

Decision  Makers 

Project  Director 

Project  Staff 

Others 

Other  Resources 

Content 

Select 

Materials /Equipment 

Appearance 

Develop /modify 

Facilities 

Roles /image 

Allocate 

Funds 

Avallabllltv 

Plans  and  Constraints 

Content 

Select 

Roles/lianage 

Develop/modify 

Availability 

Students 

Goals /ad dltudes 

Select 

Skills/knowledge 

Train/ Inform 

Aptitude 

Elicit 

Etoles/ Image 

Allocate 

Availability 

Figure  6>    Descriptive  conventions  for  diffusion-system  models. 
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those  in  the  PIPs»  dlBBeminator's  operating  plans»  and  so  on*  Constraints 
include  all  other  relevant  laws  and  guidelines »  from  federal  laws  to  un^ 
written  local  policies* 

5*2*2*2    Categories  of  initial  conditions  and  outcomes*    There  are 
many  ways  we  could  describe  the  components  of  a  system*  but  the  following 
categories  have  evolved  as  particularly  convenient  for  organizing  the 
descriptions  of  educational  dif fusion^system  components: 

#  Personnel  and  students 
^  Goals/attitudes 

^   Skills /knowledge 
*-    Aptitude  (students) 
Roles/image 

*  Availability 

#  Other  resources  (materials »  facilities »  funds »  etc*) 

*  Content 

*-  Appearance 
^    Roles /image 

-  Availability 

#  Plans  and  constraints 
**  Content 

^  Roles/image 

-  Availability 

These  categories  are  interpreted  broadly*  so  as  to  include  virtually 
all  of  the  characteristics  that  have  been  identified  to  date  by  RHC  as 
important  to  the  diffusion  process*    "Goals  and  attitudes"  inay  apply  to 
persons  or  groups  of  persons  and  are  important  to  the  success  of  any  dif- 
fusion system*    Goals  and  attitudes  are  particularly  important  to  include 
in  models  of  bilingual  projects,  where  goals  differ  widely  and  attitudes 
are  often  highly  emotional*    The  "skills  and  knowledge"  category  includes 
almost  anything  a  person  can  learn  except  for  attitudes*    The  "roles  and 
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image category  includes  those  characteristics  of  persons  (as  perceived 
by  others)  such  as  authority*  credibility*  and  so  on.    In  addition*  the 
organization  of  a  group  may  be  critical  to  the  diffusion  of  effective 
projects,  and  the  organizational  structure  plus  the  individual  roles 
within  the  organization  are  included  under  this  category.    Finally*  the 
^'availability**  of  personnel  includes  both  the  number  of  personnel,  and 
the  amount  of  time  that  each  is  involved  in  specified  activities. 

The  most  complex  '^other  resources**  in  project  diffusion  systems  are 
usually  materials  such  as  manuals,  texts,  awareness  brochures,  and  so  on. 
These  are  described  primarily  in  terms  of  their  content  and  their  physical 
appearance,  but  their  roles  in  the  system  and  their  image  in  the  eyes  of 
the  users  is  also  important.    Availability  here  includes  all  considera- 
tions bearing  on  whether  the  intended  users  can  and  do  get  access  to  the 
materials. 

For  other  resources  such  as  facilities  and  funds,  there  may  be  little 
or  no  description  in  terms  of  **content.**    ^'Appearance'*  applies  to  facili- 
ties but  not  to  funds.    "Roles'*,  and  "availability'*  apply  to  all  resources. 

**Plans  and  constraints**,  like  materials,  have  content.    Plans  and 
constraints  (e.g.,  lavs  and  guidelines)  have  no  physical  properties,  and 
therefore  no  category  is  included  for  appearance.     If  guidelines  are 
written  down  (as  in  a  PIF)  ,  then  the  pages  or  manuals  are  considered  **ma- 
terials,*'  and  the  guidelines  are  the  contents  of  the  materials.    The  com- 
plexity and  wording  of  rules  or  regulations  is  important,  and  is  described 
under  **content*'.    **Roles  and  image**  apply  to  laws  and  guidelines  as  they 
do  to  all  system  components.    *'Availability**  is  a  somewhat  more  complex 
category  for  plans  and  constraints  than  for  other  system  components  because 
it  includes  a  variety  of  features  such  as  whether  the  laws  or  guidelines 
are  explicit  or  implicit,  formal  or  informal,  known  or  unknown,  enforced 
or  unenforced. 

5.2.2.3    Categories  of  processes.    By  *'processes**  we  mean  all  the 
system  activities  intended  to  obtain  or  change  the  people  and  other  compo- 
nents of  a  diffusion  system  in  order  to  arrive  at  the  ultimate  system  goal 
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that  is^  adopter-site  projects  that  are  serving  the  students  well.  Each 
process  is  described  in  terms  of  four  elements.    In  conventional  terms 
these  are  "Who  does  what  to  whom^  and  when?"    That  is»  a  description  of  a 
process  includes  (a)  the  active  component  (or  combination  of  components}^ 
(b)  the  action  itself »  from  one  of  the  categories  of  processes  listed 
belowi  (c)  the  person  or  other  component  acted  upon»  and  (d)  any  time 
period  or  sequence  considerations  important  to  the  process. 

Ah  was  the  case  with  components »  processes  have  been  divided  into 
categories  that  help  to  organize  the  description  of  a  system.    These  four 
categories  represent  the  different  kinds  of  things  that  can  be  done  in 
order  to  develop  a  diffusion  system  in  which  personnel^  materials,  and 
other  components  are  in  place  and  doing  their  respective  Jobs.    The  cate** 
gories  are: 

#  Select 

#  Modify/develop  (train/inf om) 

#  Elicit  (applies  only  to  persons) 

#  Allocate 

It  is  intended  that  all  processes  in  a  diffusion  system  should  fit  into 
one  of  these  categories »  which  &re  described  briefly  below. 

Select.    The  first  two  categories  cover  the  different  ways  of  insur- 
ing that  personnel »  materials  and  other  components  are  appropriate  to 
their  Jobs.    The  first  category,  "select^"  includes  all  activities  involved 
in  obtaining  components  that  already  exist  with  the  desired  characteristics. 
Thus»  personnel  yith  appropriate  skills^  knowledge^  attitudes^  roles^  and 
so  on  might  be  identified^  recruited »  and  hired.    Materials  could  be  iden- 
tified and  purchased^  suitable  project  guidelines  could  be  obtained  from 
other  projects.    All  such  activities  would  be  included  under  the  general 
heading  of  "selection". 

Modify/develop.    Where  suitable  system  components,  either  people^ 
materials^  or  plans^  are  not  available  "off  the  shelf^"  it  may  be  neces- 
sary to  "modify"  existing  ones  or  "develop"  new  ones  from  scratch. 
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Persono  can  be  modified  by  Inforclng  or  training  them.    Their  roles  can  be 
changed  by  assigning  thLm  to  new  positions.    Materials  and  guidelines  can 
be  modified »  or  new  ones  can  be  developed.    In  short,  If  the  required  Per- 
sons* materials*  and  other  components  are  not  available  through  selection 
processes^  the  system  must  provide  for  the  necessary  training^ and  develop- 
ment. 

Elicit.    A  special  category  is  required  to  cover  processes  Intended 
to  ensure  that  personnel        already  have  the  required  skills  actually 
perform  as  Intended.    The  category  is  labeled  "elicit,"  and  Includes  pro*- 
'^esses  that  motivate  or  constrain  persons  but  do  not  provide  any  new  skills 
or  knowle<Ige.    Awarding  bonuses,  assigning  penalties,  and  providing  plea- 
sant working  conditions  would  all  be  Included.    The  effect  Is  to  change 
attitudes  (which  may  also  be  charged  by  Informing  or  training)  without 
changing  skills  or  knowledge. 

Allocate.    The  final  category  of  processes  is  labeled  "allocate." 
This  category  refers  to  the  processes  of  physically  moving  components  to 
wherever  they  are  needed.    In  the  case  of  laws  and  guidelines,  dlssemina^ 
tlon  and  enforcement  would  be  Included. 

5.2.3    Conventions  for  Organizing  ComPonantst  Processes^  and  Outcomes 
into  a  Model 

S.2.3.1    Assigning  process  statements  to  components.    In  developing 
a  model  of  a  particular  diffusion  system,  components  (people,  other  re* 
sources,  and  plans  end  con^straints)  are  represented  by  rows  (Figure  7). 
Thus,  for  example,  there  is  a  row  for  the  project  director  process  and 
outcome  statements*    However,  there  is  a  basic  convention  that  must  be 
established  before  beginning  to  fill  in  the  project  director's  row.  In 
particular,  a  process  statement  is  of  the  form,  "Vh6  does  what  to  whom?" 
The  "^o"  and  the  "whom"  are  both  components  of  the  system,  so  each  has 
its  individual  row.    Logically,  a  process  statement  could  be  listed  in 
either  row. 
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/Action  1  Time 

Action  1  Time 

Action  Time 
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Diffusers 
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Figure  7.    Framework  for  the  "intended"  PIP-dif fusion  system  model. 
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It  turns  out  that  both  ways  of  ;\rouping  process  statements  are  useful. 
Grouping  by  **who**  (the  subject  of  the  process  statements)  provides  a  job 
description  for  each  component,  that  is,  a  list  of  all  the  processes  each 
component  is  expected  to  complete.    Grouping  by  **to  whom**  (the  objects  of 
the  process  statements)  provides  a  list  of  all  the  processes  acting  upon  a 
component.    Grouping  by  subject  provides  the  most  intuitive  arrangement 
(i.e.,  job  descriptions),  and  this  grouping  is  done  as  a  final  step  in  the 
analysis  of  the  systems  in  order  to  prepare  an  easily  understood  system 
description*    Hovever,  for  the  purposes  of  the  analysis  and  revision  of  the 
system,  the  statements  must  be  grouped  by  objects  (i*e. ,  to  whom),  in  order 
to  see  why  a  component  is  not  functioning  In  the  system  as  intended*  Thus, 
for  example,  a  statement  of  the  general  form»^*TRC  trains  PD**^  is  listed 
in  the  Project  Director  row,  not  the  TRC  row. 

The  rationale  is  that  the  models  are  used  for  an  %ut comes -*oriented^* 
approach  to  analysis*    Analyses  focus  on  the  final  outcomes  that  a  system 
is  intended  to  produce  (i.e.,  operational,  educational  programs  with  spe* 
ciiic  features  achieving  specific  goals  and  objectives)  and  on  the  intern- 
mediate  outcomes  that  lead  to  the  final  outcomes*    Outcomes  are  stated  in 
terms  of  component  characteristics  (e*g»,  student  skills,  project-director 
skills),  and  if  some  outcomes  are  missing,  the  first  step  In  figuring  out 
why  is  to  review  &11  processes  intended  to  produce  those  outcomes.  To 
facilitate  this  revi^,  all  the  directly  relevant  processes  should  be 
grouped  together.    Therefore,  the  basic  arrangement  of  the  process  state- 
ments is  to  group  them  by  the  **to  whom**  or  objects  of  the  process  state- 
ments.    (The  USOE  rows,  for  example,  reflect  all  processes  affecting  USOE, 
not  all  processes  in  which  USOE  is  involved.)    \lthough  this  organization 
initially  strikes  most  researchers  as  quite  contrived  and  awkward,  in 
practice,  it  greatly  expedites  analysis  of  the  system. 

5.2.3.2    Dividing  components  into  groups.    Components  are  divided 
into  groups  and  subgroups  based  on  the  organizations  that  are  involved  in 
the  particular  diffusion  system  being  planned  or  analyzed.    The  decision 
as  to  how  to  group  components  is  a  purely  pragmatic  one.    The  major  groups 
and  subgroups  in  the  bilingual-PlP  diffusion  system,  for  example,  are; 
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•  USOE 

-  OBE 

-  OPBE 

•  Diffueera  (primarily  TRCa) 

•  LEAa 

In  general,  each  group  and  aubgroup  will  include  all  the  kinds  of  compo* 
nenta,  that  la,  peraona,  oaterials,  and  ao  on,  but  each  will  have  an  iden* 
tity  or  character  of  its  (>wn  that  la  more  than  the  aum  of  ita  parta* 

5*2*3*3    Dividing  proceaaea  into  atagea*    So  many  proceaaea  are  di- 
rected toward  ao  many  different  goala  in  a  diffuaion  syatem  that  ati  addi- 
tional breakdown  la  required  before  a  ayatem  deacription  becomea  manage*^ 
eble*    Thia  breakdown  la  a  diviaion  into  aequential  ^'atagea'^  of  proceaaea* 
The  breakdown  that  haa  evolved  for  the  particular  caae  of  PIP  diffuaion 
ayatemii  divides  the  overall  diffuaion  proceaa  into  four  logically  distinct 
atagea  (aee  Figure  7): 

•  Preparation  for  diffuaion 

•  Selection/adoption 

•  Start*up 

•  Operation 

Each  stage  is  defined  to  include  a  apecific  aet  of  proceaaea*  In 
the  PIP  model,  Prenara tion  includes  all  USOE  and  diffuaer  planning  and 
all  aelectlon  and  training  of  diffuaera  prior  to  contacting  LEAa  with 
awareneaa  activitiea*    Selection/AdoPtion  includea  proceaaea  for  creating 
awareneaa  in  the  LEAa,  for  narrowing  the  choicea  to  one  or  more  auitable 
proj^cta,  and  for  obtaining  commitment  to  adopt  the  project  or  projecta* 
Start-Op  covera  getting  ready  for  the  firat  year  of  operation,  and,  in 
particular,  includea  those  proceaaea  that  need  to  be  done  only  the  firat 
year*    As  deacribed  in  the  PlPa,  atart**up  ia  An  accelerated  or  altered 
veraion  of  the  alow,  evolutionary  project  development  in  many  of  the  orig- 
inating aites*    "Operation"  begina  with  the  arrival  of  the  first  atudenta 
in  the  project  clasarooma* 


A  fifth  column,  labeled  "Initial  Conditions"  Is  also  Included  In 
Figure  7.    This  coliimn  provides  a  place  for  listing  all  of  the  processes 
and  outcomes  relevant  to  the  diffusion  system  prior  to  the  defined  begin- 
ning of  the  preparation  stage.    Since  It  has  no  specific  bef^.lnnlng*  "ini- 
tial conditions*'  Is  not»  strictly  speaking*  a  stage.    It  Is  Intended  to 
eliminate  the  need  for  an  Infinite  regression  of  preparation  stages  that 
would  otherwise  be  required. 

In  practice*  of  course*  the  stages  cannot  always  be  separated  neatly. 
Preparation  continues  Into  s elect lon/adoptlon,  and* so  on.    But»  In  general* 
there  are  observable,  Intermediate  outcomes  that  are  Identifiable  for  each 
stage*  and  It  Is  these  Intermediate  outcomes  that  make  the  study  of  a  dif- 
fusion system  possible*    That  ls»  while  the  ultimate  outcome  of  the  diffu- 
sion system  Is  improved  student  performance  and  self-concept*  there  Is  no 
practicable  way  of  evaluating  the  effectiveness  of  preparation  processes 
by  looking  at  student  test  scores  (l*e.,  outcomes  of  operation}*  Each 
stage  must  first  be  analyzed  separately,  and  then  the  outcomes  of  each 
stage  (the  skills*  knowledge*  content*  roles,  and  availability  of  the 
components)  must  be  considered  In  terms  of  their  implications  for  the 
following  stages* 

5.2.4    Using  the  Descriptive  Conventions  to  Develop  a  System  Model 

5.2.4.1    Sequence  of  model  development.    With  the  conventions  for 
describing  components  and  processes  established,  It  Is  possible  to  consi- 
der how  these  two  kinds  of  statements  are  actually  used  in  developing  a 
complete  description  or  model  of  a  diffusion  system.    The  first  step  Is  to 
list  all  the  components  In  the  system,  grouped  appropriately  under  "USGE^', 
"Dlffusers,'*  or  "LEAs^*  and  then  to  describe  their  Initial  conditions^  that 
Is,  their  characteristics  prior  to  the  beginning  of  preparation  for  diffu- 
sion.   In  general.  It  Is  not  necessary  to  describe  the  status  of  Individ- 
uals under  Initial  conditions.    For  example,  "LEA  persons,"  (decision- 
makers, project  director,  project  staff,  non-project  staff,  parents,  and 
community)  are  described  In  general  terms,  summarizing  their  status  In 
potential  adopter  sites* 
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The  second  step  Is  to  consider  all  the  preparation  processes  that 
act  on  the  various  components.    Thus»  USOE  personnel  are  selected  to  over* 
see  the  diffusion  effort »  funds  are  allocated »  plans  are  developed »  and 
so  on.    In  the  diffusion  group^  USOE  selects  and  trains  diffusion  agents^ 
and  the  diffusers  develop  specific  diffusion  plans.    At  the  LEA  levels  LEA 
pereonnel  are  not  usually  involved  at  this  stage,  but  LEA  plans  and  guide* 
lines  are  being  selected  by  UFOE  and  packaged  in  the  form  of  PIPs. 

The  results  of  these  preparation  processes  are  then  described  under 
the  heading  ^^preparation  out  comes.      The  description  of  preparation  out- 
cooes  is,  in  principle,  a  complete  description  of  all  system  components, 
similar  to  the  description  of  '^initial  conditions'^  but  reflecting  the  new 
knowledge,  plens,  materials,  snd  so  on  resulting  from  preparation  proc* 
esses.    In  practice,  only  the  new  or  changed  charscteristics  need  be 
listed. 

Next,  the  select ion /adopt ion  processes  are  described  as  they  operste 
on  the  components,  and  changes  in  components  are  described  under  ^'selec* 
tion/adoption  outcomes Similarly,  ''start--up"  processes  snd  outcomes  are 
described,  and  finally  ^'operation*'  processes  and  outcomes  are  described. 
The  resulting  description  includes  all  components  of  the  system,  and  fol* 
lows  all  changes  to  them  over  the  four  stages  of  diffusion. 

'  5.2.4.2    Levels  of  detail.    The  same  basic  conventions  can  be  applied 
at  any  level  of  detail  or  generality.    Thus,  at  one  extreme,  the  adoption 
at  a  single  site  could  be  described  in  t«irms  of  the  specific  people  and 
materialj  involved  in  all  the  groups  and  at  all  stages  of  the  diffusion 
effort.    At  the  other  extreme,  educational  diffusion,  in  general,  could  be 
described  in  terms  of  generic  groups  snd  the  processes  acting  upon  them  at 
each  stage  of  diffusion.    The  decision  as  to  how  much  detail  to  include  is 
largely  a  practical  one.    In  an  evaluation  of  an  elaborately  planned  dif-- 
fusion  system  for  highly  structured  projects,  a  high  iaveX  of  detail  would 
be  required  to  capture  all  of  the  places  where  things  vent  wrong.    In  an 
exploratory  effort  such  as  the  bilingual-PIP  dissemination  study  in  which 
relatively  unstructured  projects  are  diffused,  a  more  general  level  of 
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description  is  required*    All  descriptions  used  in  this  study  would  be 
clsssified  as  quite  genersl  in  their  level  of  detsil* 

5*2*5    Project  Models  and  Other  Specisl  Summsriea 

The  model  of  the  complete  bilingual  PIP  diffusion  effort  provides  the 
basic  structure  for  organising  the  raw  dsta  from  the  process  evaluation) 
i*e*,  site  visit  notes,  inputs  from  project  directora  and  disseminators, 
and  information  from  the  Office  of  Educstion*    In  principle,  all  details 
of  relevance  should  be  included  in  the  appropriate  sections  of  the  model; 
and  the  resulting  model,  vhich  exists  on  psper  as  a  lengthy,  working  out- 
line, is  the  basis  for  all  analyses  in  the  study*    To  fscilitate  aome  of 
the  snalyses,  however,  aeveral  kinds  of  summaries  are  prepared  from  the 
model  of  the  complete  diffusion  effort*    The  most  important  aumntaries  aret 

a*    The  diffusion  process  summsrised  by  the  groups  comprising  the 
system  (i*e*,  summaries  of  the  rows  of  the  model)*    For  the  PIP 
diffusion  model,  these  sre  summaries  of  all  processes  (and  re- 
lated outcomes)  affecting  USOE,  diffusers,  snd  target  LEAs, 
respectively* 

b*    The  diffusion  procesa  summsrised  by  stsges  (columns  of  the 

model)*    This  form  is  used  in  Section  7>  Results  snd  Analysia* 

c*    Stimmsries  of  the  project  chsracteristics  (called  "project  models'* 
in  this  report) * 

d*    Summsries  of  local  evaluation  designs* 

Evsl^ation  designs  sre  discussed  in  Sections  9-13  of  this  volume*  The 
other  three  types  of  summsries  are  used  in  the  process  snslyses,  ss  de- 
scribed below* 
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5*3    Utflnfi  the  Models  for  Proceaa  Analyaea 


As  already  diacuaaed»  the  baaic  approach  uaed  in  the  proceaa  evalua- 
tion ia  to  (a)  deacribe  vhat  was  intended  to  happen  in  the  diffuaion  aya- 
tem»  (b)  deacribe  what  actually  happened^  (c)  analyze  what  went  wrong»  and 
(d)  recommend  waya  to  improve  the  ayatem*    The  format  for  deacribing  the 
intended^  actual  and  recommended  ayatma  ia  provided  by  the  model  conven- 
tiona,  above*    Thia  tection  explaina  the  approach  to  analyzing  what  went 
wrong  and  generating  recommendationa  for  Improvements* 

5*3*1    Comparing  Project  Modela 

The  project  models  (aee  Section  5*2*5»  above)  provide  a  standard 
format  for  deacribit^g  the  management  and  inatructional  featurea  of  a  proj- 
ect*   Although  the  same  information  ia  included  in  the  dif fuaion-ayatem 
model,  it  ia  organized  there  to  facilitate  tracing  the  effects  of  diffu- 
sion activitiea  on  different  project  elements*    The  project  models,  by 
contrast^  consist  of  a  more  familiar  organization  of  the  goals,  instruc- 
tional features  and  management  features  of  the  project*    The  project-model 
format  is  intended  to  provide  a  straightforward  description  of  any  project, 
whether  or  not  it  is  involved  in  a  diffusion  syst^* 

The  primary  use  of  the  project  models  is  to  depict  the  overall  impact 
of  the  diffusion  system*  Four  kinds  of  models  are  involved  in  this  analy- 
sis: 

a*    Mbdels  of  developer-site  projects    (four  oites) 
b*    Mbdels  of  projects  as  described  in  the  FIFs    (four  sites) 
c*    Mbdels  of  field- test-site  initial  conditions    (19  sites) 
d*    Models  of  field- test-site  operation    (19  sites) 

In  this  3tudy,  the  first  an<i  third  kinds  of  models  have  been  developed  at 
only  a  very  general  level  of  detail*    However^  this  level  of  detail  is 
sufficient  to  permit  comparison  of  all  six  possible  combinations  of  the 
four  kinds  of  models^  as  shown  in  Figure  6* 
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Field-Test  Sltea; 
Initial  Conditions 
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Figure  8*    Project^model  comparisons* 

The  questions  iiq>licit  in  Figure  8  may  be  aununarized  as  follows: 

1*    DeveloPer*site  Projects  versus  PIP-described  projects i    Do  the 
PIPs  describe  the  developer*aite  projects  accurately? 

2*    Developer-aite  projects  versus  f ield-test-aite  initial  conditions: 
Were  the  field-test  sites  different  from  the  developer  sites  be- 
fore the  diffusion  effort? 

3*    Developer'^site  projects  versus  field-test-site  operationi  How 
closely  did  the  field-test  sites  replicate  the  develop er*s it e 
projects? 

4*    FIP*de8cribed  _&rQjects  versus  f ield*test*site  initial  conditions: 
Before  the  diffusion  effort,  were  the  field-test  sites  different 
from  the  projects  c    described  in  the  PIPs? 

5*    PIP*described  projects  versus  f ield-test*site  operation;  How 
closely  did  the  field^-test  sites  replicate  the  projects  as  de- 
scribed in  the  PIPs? 


-(6)- 


Field*Test  Sites: 
Operation 
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6.    Field-' tea t*alte  Initial  condltlona  veraua  field-tea t^alte  opera-- 
tlon:    Did  the  diffusion  effort  produce  major  changea  In  the 
fleld-teat  altea? 

In  comblnatloni  the  palr*-wlae  comparlaona  of  the  four  typea  of  project 
models  anawer  the  queatlons  of  how  different  the  exemplary  projecta  were 
from  the  pre-exlatlng  practlcea  In  the  tryout-altea,  and  whether  the  dlf* 
fualon  effort  resulted  In  changing  the  tryout-alte  practlcea  to  reaanbla 
the  exemplary  projecta. 

A  aeventh  queatlon  became  very  Important  In  the  blllngual-PIP  field 
teat.    Thla  queatlon  waa""How  closely  did  the  fleld*test  sites  replicate 
aomethlng  elae  (e.g.,  neighboring  LEA  programa,  general  Title  VII  gulde- 
llnea,  and  ao  on)?"    Such  unintended  outcomea  may  be  Important  In  ntoat 
dlf fualon  aystana. 

5.3.2    Identifying  Dlf  fualon  Syatem  Problema 

Once  the  Impact  of  the  ayatem  has  been  deacrlbed,  the  dlffualon  aya- 
tem  la  analyzed  to  Identify  apedflc  problma.    Flrat,  the  model  of  the 
Intended  dlffualon  ayatem  la  compared  cell-by-cell  with  the  models  of  the 
actual  diffusion  aystema  for  each  TRG  and  tryout-alte  combination.  Thla 
analyals  begins  where  the  comparison  of  the  project  modela  enda.  The 
actual  LEA  operation  of  the  project  la  compared  with  the  Intwded  opera- 
tion aa  deacrlbed  in  the  pip  (Queatlon  5,  above).    Outcomes  are  compared 
flrat»  and  where  the  actual  outcomea  fall  abort  of  intended  outcomea,  the 
proceaaea  dealgned  to  enaure  thoae  outcomes  are  examined.    Where  proceaaea 
operated  aa  planned  but  failed  to  produce  the  dealred  outcome,  a  notation 
la  made  o£  the  Inadequate  proceaa.    Where  a  proceaa  failed  to  opeiate  aa 
intended,  the  outcomea  from  the  preceding  atage  are  examined  to  aee  why. 
In  many  caaes  it  will  be  neceasary  to  continue  tracing  cauaea  back  to  the 
initial  condltlona  stage;  and  in  moat  caaea,  a  tree**llke  chain  of  problema 
will  be  found  to  lie  behind  each  outcome  that  la  not  met. 
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5.3.3    Determining  Causes  of  Problems 


In  order  to  understand  the  role  of  the  models  In  this  analysis^  It 
Is  useful  to  think  In  terms  of  two  kinds  of  questions: 

•  What  happened? 

•  Why? 

The  first  question,  and  the  one  to  which  the  models  are  addressed.  Includes 
Which  outcomes  were  not  achieved?    Which  process  or  combinations  of  pro* 
cesses  failed  to  operate?  Which  operated  but  failed  to  produce  the  desired 
results?    The  second  kind  of  question  Is:    What  are  the  underlying  reasons 
that  the  processes  failed  to  operate  or  failed  to  produce  the  desired  re** 
suits?    For  example,  a  desired  outcome,  as  Included  In  the  model,  might 
be  "positive  staff  attitudes.**    If  negative  attitudes  were  observed,  the 
relevant  processes  In  the  model  would  be  examined  (e.g.,  training  and  orl-* 
entatlon  sessions),  as  well  as  relevant  assumptions  about  Initial  condl"* 
tlons  (e.g.,  no  hostility  toward  bilingual  education). 

Following  the  model  In  this  way  would  pinpoint  where  the  problan  oc* 
curred,  but  determining  the  reasons  for  the  problem  requires  going  beyond 
the  model.    There  Is  no  set  procedure  for  determining  reasons.  Although 
educational  diffusion  studies  and  the  work  on  diffusion  done  In  the  area 
of  communications  research  provide  many  helpful  Insights,  at  this  point 
the  analysis  becomes  a  matter  of  professional  Judgment  and  common  sense 
(although,  at  least  In  principle,  most  problems  for  which  the  reasons  are 
not  obvious  could  be  studied  via  appropriate  experimental  techniques). 

5.3.4    Reversing  the  Direction  of  the  Analysis 

The  above  analysis  Is  followed  for  each  major  outcome.    The  result 
Is  a  set  of  overlapping  problem  sequences  llnklrg  unmet  outcomes  of  the 
earlier  stages  to  subsequent  difficulties.    OncO  all  recorded  problems 
have  been  traced  back  to  their  causes,  most  of  the  weak  points  In  the  sys** 
tern  will  clear.    The  analysis  Is  then  reversed,  starting  with  unmet 
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Initisl  Conditions  and  tracing  forward  through  Preparation,  Selection/Adop- 
tion,  Start*-up,  and  Operation  in  en  attempt  to  identify  any  additional 
;iroblemB  that  had  not  been  previously  apparent* 

5*3*5    Developing  Problon  Themes 

Finally,  the  loajor  unioet  processes  and  outcomes  are  listed  at  each 
stage,  and  the  consequences  are  summarized  in  the  form  of  Problem  themes* 
An  example  of  a  major  problem  theme  is  the  consequences  of  not  having 
bilingual  staff  in  the  tryout  sites*    Availability  of  competent  bilingual 
teschers  is  a  precondition  for  all  four  PIP  projects,  and  some  consequences 
are  (s)  rejection  by  many  sites  of  the  projects  at  the  Selection/Adoption 
stage,  (b)  utilizing  bilingual  aides  in  a  major  teaching  role  (which  may 
lead  to  additional  problems)  or  (c)  consuming  staff  development  efforts  in 
teaching  a  second  language  to  teschers,  rather  than  training  the  staff  in 
effective,  bilingual  teaching  methods* 

The  problem  themes,  then,  summarized  across  sites  provide  a  picture 
of  what  went  wrong  and  why*    A  summsry  of  successfully  implemented  pro^* 
cesses  snd  successfully  achieved  outcomes  provides  a  picture  of  what 
worked*    Together,  the  complementary  pictures  of  what  went  rig^ht  and  what 
went  wrong  constitute  the  starting  point  for  recommending  a  more  effec^ 
tive  delivery  systeir.* 

It  should  be  made  clear,  that  while  describing  the  snalysis  approach 
is  a  rather  laborious  task,  the  approach  itself  is  a  very  simple,  common- 
sense  way  of  looking  for  the  csuses  of  problems  and  the  consequences  of 
unmet  preconditions*    For  the  study  of  unsophisticated  systems,  the  for- 
malizstion  of  this  part  of  the  analysis  processes  has  s  relatively  minor 
impact  on  the  study  results*    It  is  the  set  of  conventions  for  organizing 
the  informaf^  ^  into  internally  consistent  models  that  is  the  key  to  the 
analysis*    ;   ^e  the  models  are  completed,  examination  of  the  models  for 
problems  and  thair  causes  is  relatively  straightforward* 
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5.3.6    Using  the  Models  for  Planning,  and  Revision 


^  As  mentioned  above »  the  modeling  process  was  also  the  key  to  preparing 
recommendations  for  diffusion  systems  that  would  meet  various  USOE  goals. 
A  major  problem  In  developing  successful  diffusion  systems  In  the  past  has 
been  to  take  Into  account  the  many  people*  agencies*  materials*  and  regu* 
latlons  that  affect  diffusion  efforts*  and  to  sort  out  the  fuactlons  that 
each  would  nave  to  fulfill  If  the  systems  were  to  work  as  Intended.    As  a 
planning  tool*  the  set  of  modeling  conventions  provides  an  aid  to  describ- 
ing all  of  the  components  of  an  Intended  system*  displaying  their  expected 
functions  and  Interrelations*  and  relating  the  Information  gained  from 
observing  various  existing  diffusion  efforts  to  the  Intended  system.  In 
this  way  a  new  system  can  capitalize  on  diffusion  approaches  that  have  been 
proven  effective*  and  avoid  reliance  on  techniques  that  have  been  shown  to 
be  Ineffective. 
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6.  METHODOLOGY 


6.1    Instrument  Development 

6.1.1  Level  of  Detail  for  Data  Heeds 

The  descriptive  models  define  the  questions  to  be  answered.  That 
±&f  WE  need  to  know  the  status  of  each  dlf f uslon-^syjstem  component  prior 
to  the  preparation  stage  and  at  the  end  of  each  successive  stage.    We  also 
need  to  know  the  processes  acting  upon  each  component  (as  well  as  the  pro-* 
cesses  for  which  each  component  Is  responsible)  at  each  stage.    The  prac*- 
tlcal  concern  In  developing  data  needs  Is  the  level  of  detail  at  which  to 
work.    It  may  be  adequate  to  deal  with  some  components  and  processes  at  a 
very  global  level*  while  others  my  require  highly  detailed  description 
and  analysis  In  order  to  design  a  system  th.it  produces  the  desired  results. 
The  question  Is  how  to  decide*  since  the  solution  of  dealing  with  every 
aspect  of  the  system  In  minute  detail  Is  simply  not  practicable. 

The  answer  Is  that  there  Is  no  formula  that  can  tell  us  In  advance 
what  will  be  Important  and  what  will  not.    Basically*  a  process  of  In- 
formed trial  and  error  Is  required.    The  approach  described  below  Is 
simply  an  orderly  method  of  applying  the  trial  and  error  approach.  For- 
tunately* a  great  deal  of  experience  has  been  gained  In  using  this  ap- 
proach over  a  flve**year  period*  and  effective  guidelines  for  proceeding 
have  been  established.    Then  too*  the  methods  used  result  In  an  efficient 
trial  and  error  approach.    That  Is*  except  where  past  experience  suggests 
the  need  for  detailed  data  collection*  data  are  collected  at  a  general 
level.    Then*  where  problems  In  the  system  are  Identified*  additional* 
more  detailed  data  are  collected  until  the  reasons  for  the  problems  are 
fully  resolved.    Thus*  collection  of  unnecessary  detail  Is  minimized. 

6.1.2  Individualized  Interview  Guides 

6.1.2.1    Rationale.    The  conventional  approach  to  conducting  a  large- 
scale  study  of  this  kind  would  be  to  generate  <a  questionnaire  for  each 
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cstegory  of  personnel*  together  with  standard  clsssroom  observstion  and 
interview  forms.    Data  would  be  collected  in  a  uniform  manner»  ^ich  would 
lend  itself  to  subsequent  compsrisons  smong  sites. 

In  the  current  study»  such  sn  approsch  would  not  hsve  been  productive* 
in  psrt  becsuse  the  sites  were  very  different  from  each  other»  and  in  part 
because  the  stujy  was  basicslly  exploratory.    The  wide  variety  of  s' 
and  the  resulting  variety  of  ImpletDentations  mesnt  that  only  a  subset 
any  fixed  questionnaire  would  hsVe  been  relevant  to  any  given  site.  The 
exploratory  nature  of  the  study  required  thst  the  unique  f sctors  inf luenc*-' 
ing  implementation  in  esch  site  be  pursued  in  depth »  s  process  to  which 
standsrd  quesLionnsires  contribute  little. 

Furtbermore»  past  experience  has  shown  thst  the  Implicstions  of  iso*- 
lated  findings  from  s  given  site  can  only  be  understood  in  the  context 
of  s  complete  picture  of  thst  site.    In  other  words»  it  is  the  interac- 
tions of  site  characteristics  snd  events  thst  provide  mesningful  insights* 
and  these  interactions  sre  so  varied  from  site  to  site  that  s  single  set 
of  questions  designed  to  cspture  sll  of  the  relevant  interactions  in  sll 
of  the  sites  would  hsve  been  so  msssive  as  to  be  imprscticsl. 

Clesrly»  vhst  was  needed  was  s  system  of  quest ionnaires»  unique  to 
each  site»  but  coordinated  through  a  common  plsn  for  data  analysis.  In 
this  study»  the  dsta-anslysis  spprosch  described  in  Section  5.3  provided 
the  coordinstion  scross  sites.    The  small  rumber  of  sites  (in  general* 
four  sites  per  site-visit  team)  made  it  possible  to  develop  individusliz'td 
dsta  collection  iiistruments  for  each  site. 

6.1.2.2    Development  of  Individualized  interview  guides.    The  pur- 
pose of  the  data  collection  visits  was  to  develop  s  complete  model  of  the 
sdoption  and  implement stion  processes  and  outcomes  for  esch  site.  The 
model  of  the  intended  diffusion  system  provided  the  preliminary  content 
for  esch  site  model  priov  to  the  first  site  visit.    The  major  source  of 
information  on  the  intended  syptem  wss»  of  course*  the  set  of  PIPs.  A 
second  importsnt  source  was  the  set  of  Title  VII  grant  proposals  from  the 
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field^test  sites.    These  documents  provided  a  great  deal  of  information 
about  LEA  initial  conditions »  as  well  as  some  indication  of  selection/ 
adoption  outcomes  and  LKA  plans  for  actual  start-up  and  operation. 

One  final  source  of  information  was  available  prior  to  the  first 
round  of  site  visits  in  this  study.    KMC  site-visit  teams  attended  an 
August  meeting  of  field-test-site  project  directors  and  evaluatcrs  held 
by  OBE  in  Maryland.    By  observing  discussions  among  field-test-site  and 
OBE  personnel »  KMC  was  able  to  fill  in  additional  details  of  selection/ 
adoption  and  start^up^  as  well  as  plans  that  had  been  developed  for 
operation. 

The  development  of  interview  guides  then  proceeded  as  follows:  prior 
to  each  visits  the  existing  (incomplete)  model  for  each  field-test  site 
was  reviewed^  and  the  major  gaps  were  identified.    Those  for  which  the 
information  was  expected  to  be  avp^labie  were  listed^  and  the  most  likely 
sources  of  information  were  indicated.    Finally^  all  questions  were  grouped 
by  source^  resulting  in  a  list  of  questions  to  be  discussed  with  each  per- 
son at  the  field-test  site. 

For  example,  the  start-up  workshop  is  a  feature  of  all  PIPs.    In  gen- 
eral, the  information  as  to  if  and  when  such  a  workshop  had  been  held  was 
available  prior  to  the  first  visit.    For  a  site  that  did  not  hold  a  work-* 
shop,  only  a  single  question  was  included  for  the  project  director  as  to 
why  the  workshop  was  not  held.    For  a  site  that  had  held  a  workshop,  ques- 
tions as  to  the  planning  and  operation  were  included  for  the  project  di- 
rector, as  well  as  questions  about  processes  and  outcomes  for  teachers, 
principals,  and  aides.    A  final  review  ensured  that  the  major  source  of 
each  kind  of  information  was  queried  in  detail,  and  that  the  time  of  try- 
out  site  staff  was  not  wasted  on  redundant  or  unnecessary  questioning. 

Upon  returning  froni  each  visit,  the  newly  acquired  information  was 
used  to  update  each  tryout-site  mo       (see  Data  Collection  and  Processing 
below).    Then,  prior  to  the  next  v^£>x£,  the  process  was  repeated,  with 
new  questions  developed  for  each  site. 
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6*1*3    Classroom  Observation  Guides 


In  planning  the  study^  It  was  originally  Intended  that  clsssroom  ob^ 
servatlon  guides  should  be  developed  at  two  levela  of  detail*    The  flrat 
levels  for  use  on  the  Initial  site  visits^  was  to  be  Indlvldusllzed  by 
PIP  and  was  Intended  to  determine  the  degree  of  adherence  to  PIP  speclfl<" 
cations  at  a  very  general  level*    A  second^  more  detailed  guide  for  sub- 
aequent  vlalts  was  to  be  tailored  to  each  site's  apeclal  characteristics 
based  on  the  findings  from  the  flrat  vlalt*    The  purpose  of  the  detailed 
guides  was  to  have  been  to  focus  data  collection  on  thoae  aresa  In  which 
sites  attempted  to  replicate  PIP<"Speclf led  project  featurea  and  to  avoid 
collecting  data  on  conventional  Instructional  practlcea  that  had  been 
retained  from  pre^PIP  daya* 

It  became  apparent  from  the  first  two  rounds  of  site  vlalts  that  the 

* 

approach  to  developing  second*-level  guides  required  some  modification* 
The  reaaon  was  a  combination  of  the  lack  of  specific  claasroom  features 
deacrlbed  In  the  PIPs  and  the  extent  of  adaptation  on  the  part  of  the 
adopter  sltea*    For  example^  the  Venceremos  PIP  statea  that  the  teachera 
have  flexibility  In  determining  the  appropriate  language  of  Inatructlon  for 
Individual  students »  but  no  apedflc  guidelines  are  offered*    Clearly »  to 
deacrlbe  Instruction  based  only  on  PIP  specifications  would  have  resulted 
In  an  Incomplete  picture* 

In  order  to  provide  the  required  structure  for  classroom  observations » 
KMC  made  use  of  the  project<"iaodel  categories  In  the  development  of  obser^ 
vatlon  guldea  (see  Voltme  II}*    These  categories  were  derived  from  a  logi- 
cal analyals  of  blllngual^program  management  and  Instructional  features^ 
and  were  Independent  of  apeclflc  PIP  content  or  tryout-slte  featurea.  In 
effect »  the  categorlea  provided  a  common  framework  within  which  the  four 
PIP  projects  and  the  19  tryout-slte  projects  could  be  described  and  compared* 

The  end  result  waa  that  each  team  developed  site-specific  Instruments 
for  each  visit  based  on  (1)  PlP-speclf led  featurea^  (2)  the  Inatructlon 
section  of  the  project^model  categories^  and  (3)  Information  obtained  from 
the  preceding  site  vlalts* 
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6.2    Data  Collection  and  Processing 


6.2.1    Data  Collection 

The  development  ojl'  data  collection  guides  Is  described^  abovei  under 
Instrument  Development.  This  section  Indicates  the  types  of  data  collec*- 
tlon  activity  scheduled  for  each  site  visit.  Typically,  visits  were  from 
two  to  three  days  per  site. 

Data  collection  emphasis  by  site  visit.    It  should  be  clear  from  the 
above  discussion  that.  In  general,  the  questions  asked  at  the  sites  became 
Increasingly  slte-*speclfic  with  each  visit.    However,  all  sites  were  on 
somewhat  similar  ''implementation  schedules,  and  the  Information  that  was 
available  depended  to  a  considerable  extent  on  the  timing  of  the  visit. 
Thus,  the  focus  of  each  visit  was  different  and  provided  a  unifying  thetne 
for  each  set  of  data-collection  guides.    The  major  emphases  for  the  five 
scheduled  visits  are  llsteo  below.    (In  some  sites.  Visits  II  and  III  were 
combined • } 

Site  Visit  I;  Fall  1977 

#  Selection/Adoption  Processes  and  Outcomes 

#  Start-Up  Processes  and  Outcomes 

•  Plans  for  Operation 

•  Outcome  Evaltiatlon:  Pretesting 

Site  Visit  II;  Winter  1977-78 

•  Project  Operation  Processes  and  Outcomes 
—Classroom  operation 

— Instructional  content 

—Manaj^ement 

— Staff  training 

Site  Visit  III;  Spring  1978 

#  Project  Operation  Processes  and  Outcomes 
— Chan<^es  since  winter 

— Plans  fcr  second  year 
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•  Outcome  Evaluation 
—Post  tee  ting 

— Second^year  plans 
—Observation  of  control  groups 

Site  Visit  IV;  Fall  1978 

•  Project  Operation  Update 
—Project  management 
—First-year  classrooms 

•  Observation  of  !Jew  Second-Year  Classrooms 

•  Outcome  Evaluation:    Pretesting  Procedures 

Site  Visit  V;  Spring  1979 

•  Project  Operation  Update 
"Project  management 
•^Ins  tructlon 

•  Outcome  Evaluation;    Posttestlng  Procedures 

6.2.1.2    Site  Visit  I;    fall  1977.    The  first  site  visit  took  place 
at  a  point  when  Start**up  was  largely  complete*  and  Operation  was  just 
beginning.    The  highest  priority  was  to  collect  Information  on  the  selec^ 
tlon/adoptlon  and  start'^up  stages*  and  the  basic  technique  was  to  conduct 
Individual  Interviews  with  the  project  director  and  relevant  district 
administrators.    In  general,  Interviews  were  conducted  by  a  two-person 
team  following  a  questionnaire  or  Interview  guide  developed  specifically 
for  the  Interviewee.    For  each  Interview,  one  team  member  took  primary 
responsibility  for  asking  questions  and  ensuring  that  all  Issues  were 
followed  up  appropriately.    The  second  team  member  took  primary  responsi- 
bility for  recording  answers. 

Informal  observation  of  project  classrooms  was  the  secondary  activity 
for  this  site  visit.    A  brief  narrative  description  of  classroom  operation 
was  recorded.  Indicating  the  general  Instructional  approach,  major  similar- 
ities to  and  discrepancies  from  the  PIP  model,  and  where  possible,  the 
degree  of  uniformity  across  classrooms.    In  addition,  plans  for  project 
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operation  were  reviewed  with  project  directors  and  teachers,  and  pretest- 
ing procedures  were  discussed. 

At  the  end  of  the  first  day  of  each  site  visit,  the  slte-vlslt  team 
compared  their  notes  from  the  day  with  each  other  and  with  the  preliminary 
site  model.    Discrepancies  that  could  he  resolved  and  Items  of  missing 
Information  were  listed  for  Inclusion  In  the  questions  for  the  following 
day. 

6.2.1.3    Site  Visit  II;    winter  1977-78.    The  second  site  visit  was 
scheduled  for  a  time  at  which  projects  would  be  well  underway.    The  major 
emphasis  of  these  visits  was  classroom  observation,  with  the  Intention  of 
documenting  Instructional  methods,  determining  Instructional  content,  and 
recording  the  range  of  instructional  materials  in  use.    Each  team  attempted 
to  observe  at  least  four  classrooms  and  to  cover  the  major  subject  areas 
In  which  bilingual  Instruction  was  used.    In  general,  the  observations 
lasted  about  one  hour  per  classroom,  and  were  conducted  by  both  team  mem- 
bers.   Observations  were  recorded  simultaneously  by  the  two  team  members, 
then  combined  onto  a  single  form*    Where  possible,  the  combined  form  was 
completed  on  the  same  day  as  the  observations  are  made. 

Interviews  were  a  secondary  data  collection  technique  for  Site  Visit 
II.    Both  the  content  and  the  persons  to  be  Interviewed  varied  widely 
from  site  to  site.    In  most  sites,  at  least  some  form  of  Interview  uas 
held  with  classroom  teachers.    Other  Interviews  depended  on  the  charac- 
teristics of  the  project  at  each  site  and  on  the  atage  of  implementation. 
In  all  cases,  the  project  director  was  Interviewed. 

The  third  type  of  data  collected  Included  samples  of  forms,  mate- 
rials, tests,  and  other  printed  Items.    Items  of  spedsl  Interest  were 
class  schedules,  student  assignment  sheets,  class  record **'keeplng  forms, 
locally  developed  materials  and  tests,  and  llstt  of  published  materials 
In  use.    In  sites  where  efforts  had  been  made  to  adhere  to  PIP  recommen- 
dations, complete  sets  of  such  materials  were  obtained.    Where  major 
adaptations  occurred,  only  Illustrative  samples  are  collected. 
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6.2.1.4  Site  Visit  III;    spring  1978.    Like  Site  Visit  I,  Site  Visit 
III  primarily  involved  Interviews  with  project  personnel*  snd  procedures 
similar  to  those  of  Site  Visit  I  were  followed.    The  required  Infonnatlon 
Included  reactions  to  the  first  year  of  the  project,  and  plans  for  the 
second  year.    In  most  sites,  the  project  director  supplied  otost  of  this 
Information. 

Classroom  observation  was  required  In  sites  where  the  winter  vis* 
Its  did  not  provide  a  complete  picture  of  project  Instruction.    This  oc"- 
curred  because  of  large  numbers  of  classrooms  In  the  project,  changes  In 
classroom  procedures,  or  scheduling  problems  that  made  It  difficult  to  ob* 
serve  the  complete  rangs  of  subjects  Included  In  the  project.    In  some 
site9,  classroom  obseirvation  of  comparison  groups  was  also  required  In 
order  to  assess  the  degree  of  similarity  between  treatment  and  compari- 
son conditions. 

6.2.1.5  Site  Visits  IV  and  V;    fall  1978  and  spring  1979.  The 
second^year  site  visits  Included  a  combination  of  both  Interviews  and  ob- 
servations.   In  all  sites,  the  project  directors  and  other  project  person- 
nel were  questioned  on  the  details  of  second-year  Instructional  content 
and  methods.    For  sites  having  the  most  promising  comparison  groups  and 
most  satisfactory  student  outcome  measures,  every  effort  wss  made  to 
observe  both  classroom  operation  and  testing  procedures  during  the  visits. 
Thus,  In  all  sites,  the  long-term  (second  year)  Impacts  of  the  diffusion 
effort  were  recorded,  and,  for  those  sites  best  able  to  establish  rigorous 
evaluations,  a  record  of  both  testing  and  Instructional  procedures  was 
available . 

6*2*Z    Data  Processing 

Data  processing  followed  the  data  analysis  approach  described  In 
Section  5,  and  took  the  form  of  organizing  site  visit  notes  Into  several 
complementary  sets  of  Information.    The  major  headings  are  discussed 
below. 
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6.2.2.1  Site  visit  loKlstlcs.    The  first  requirement  upon  returning 
to  the  office  was  to  record  a  variety  of  details  needed  for  future  visits. 
Though  not  strictly  part  of  process  data  analysis^  this  task  was  Important 
to  the  successful  collection  of  data  on  subsequent  visits.    Items  recorded 
Included:    (a)  schedule  of  slte^^lslt  activities^  with  times  and  places^ 
(b)  a  list  of  site  personnel  met,  with  correct  titles  and  contact  Informa- 
tion, and  (c)  a  record  of  travel  and  lodging  recommendations  for  future 
visits. 

6.2.2.2  Model  development.    The  major  data  processing  activity  was 
the  reorganization  of  slte*vlslt  notes  Into  the  format  of  the  site  project 
and  diffusion  models  (I.e.,  a  concise  outline  for  each  site,  organized 
according  to  model  conventions).    Generally,  It  was  most  efficient  to  begin 
with  the  notes  In  chronological  order,  and  transfer  each  point  to  the 
appropriate  model  heading.    Once  all  notes  were  processed,  the  model  was 
reviewed  for  gaps,  which  were  then  filled  In  If  the  Information  was  avail- 
able.   Where  It  was  not,  the  gaps  were  flagged  for  Inclusion  In  subsequent 
slte-vlslt  data-collection  guides. 

6.2.2.3  PIP  revisions.    All  fleld^test  site  personnel  Involved  in 
using  the  PIPs  were  asked  to  make  notes  in  their  PIP  materials  on  problems 
that  they  encountered  or  on  suggestions  for  improving  the  content.  Some 
personnel  were  also  asked,  in  the  course  of  interviews,  for  specific  revi^ 
sion  suggestions.    Upon  returning  from  a  site  visit,  each  team  collected 
all  such  suggestions  from  their  sites  in  preparation  for  developing  revi- 
sion recommendations.    However,  since  many  site  personnel  did  not  use  the 
manuals  in  any  depth,  and  since  it  quickly  became  apparent  that  editorial 
revisions  would  prove  inadequate,  these  notes  became  of  minor  Importance 
to  the  study. 

6.2.2.4  Site  vis  J    fliimf  r^'^g-    The  final  step  in  data  processing  was 
for  each  team  to  prepare  a  brief  summary  across  all  sites  implementing  the 
relevant  PIP  project.    Each  set  of  reports  focused  on  the  information  of 
primary  Interest  for  the  site  visit  in  question,  but  did  not  identify  sites 
by  name.    Instead,  generalizations  were  drawn  across  the  four  (or  more) 
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7*    SUBSTUDY  1:    ANALYSIS  AHD  RESULTS 


7*1  Introduction 

7*1*1    Overview  of  Results 

The  USOE  system  for  disseminating  bilingual  PIPs  represented  a  pilot 
attempt  to  diffuse  exemplary  bilingual  projects  to  carget  LEAs  (see  Sec- 
tion 1*2,  Synopsis  of  the  Bilingual  PIP  Field  Test}*    T'hls  exploratory 
effort  Involved  only  Informal  assessment  of  LEA  needs  and  of  projects 
available  to  meet  these  needs,  and  only  very  llmltrtd  development  of  dis- 
semination and  technical  support  services*    The  overall  results  were: 

•  there  was  a  rather  modest  response  to  the  dissemination  actlvl*^ 
ties, 

•  the  PIP  projects  only  partially  met  the  needs  of  adopter-sites, 

•  adopter-sites  varied  widely  In  their  capacities  to  Implement 
these  (or  any)  bilingual  programs,  and 

•  the  PIPs  and  related  technical  assistance  systems  were  only  par- 
tially able  to  meet  adopter-site  needs* 

The  Immediate  goal  of  the  diffusion  effort  wa^  for  the  fleld^test 
sites  to  Implement  the  projects  described  In  the  PIPs*    Thus,  It  might 
seem  that  the  extent  of  replication  In  the-  field-test  sites  would  be  the 
major  question  of  Interest  In  this  section*    However,  as  will  be  seen, 
the  question  of  whether  or  not  replication  occurred  Is  largely  a  semantic 
Issue*    This  was  because  o£  the  level  of  generality  of  the  PIP  specifica- 
tions and  becauae  most  of  the  recomtDended  procedures  are  fairly  standard 
In  bilingual  programs*    Therefore,  similarities  between  the  fleld^test 
site  programs  and  the  PIP  specifications  do  not  necesaarlly  Imply  that 
"replication"  reaulted  from  the  diffusion  effort,  nor  do  differences 
between  the  developer-slte  programs  and  the  f leld-test-slte  programs 
Imply  that  the  f leld^test  sites  failed  to  follow  PIP  guidelines  (see 
Section  7*6,  Operation}* 

Furthermore,  there  were  no  compelling  Incentives  to  replicate  the 
PlP^prescrlbed  projects  accurately  while,  on  the  other  hand,  there  were 


101 


strongly  competing  influences  in  the  forms  of  state  and  local  regulations 
snd  policies  that  led  to  major  departures  from  FIF  specifications.  The 
net  effect  was  that»  while  the  FIFs  and  the  related  technical  support 
helped  the  adopter  sites  to  varying  degrees^  this  diffusion  effort  did 
not  result  in  the  accurate  replication  of  exemplary  bilingual  projects. 

7*1.2    Oraanization  of  the  Analysis  and  Results  Section 

In  this  section*  the  intended  FIF  diffusion  system  is  contrasted 
with  the  actual  system  as  observed  by  RMC.    The  analysis  Is  organized 
according  to  the  framework  shown  in  Figure  7.    The  major  headings  cor* 
respond  to  stagey  of  the  intended  diffusion  system*  that  is: 

•  Initial  conditions 

•  Freparation 

•  Selection/adoption 

•  Start-up 

•  Operation 

Under  each  heading*  the  components  of  the  system  (personnel*  other 
resources*  and  plans  and  constraints)  are  divided  into  the  three  major  FIF- 
diffusion-system  groups  (USOE*  diffusers*  and  target  LEAs).    Within  each 
group  of  components*  the  processes  intended  to  affect  these  components*  as 
well  as  the  intended  outcomes  of  those  processes*  are  contrssted  with  the 
actual  processes  and  outcomes  that  BMC  observed.    Under  this  organization* 
the  replication  question — Did  the  LEAs  implement  the  intended  projects? — 
is  addressed  primarily  under  LEA  Operation*  Section  7.6.3.    Following  the 
stage-by^'Stage  analysis*  the  outcomes  are  summarized  in  Section  7.7. 

It  should  be  noted  that  this  section*  while  organized  according  to 
the  model  of  the  intended  FIF  diffusion  system*  is  only  a  narrative  summary 
of  the  analysis  that  was  carried  out.    This  analysis  consisted  of  generat- 
ing an  actual  model  for  each  field*-test  site  following  the  detailed*  in- 
tended model  presented  in  Appendix  E*  then  summarizing  across  site  models. 
Summaries  of  the  individual  site  models  are  found  in  Appendix  A* 
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7.2    Stage  0;    Initial  Conditions 

7^2A  Overview* 

7*2*1*1    Definition  of  Stage  0*    Strictly  speaking,  Initial  Condi- 
tions Is  not  a  stage  In  the  same  sense  as  the  other  four  stages  of  the 
PIP-dlf fusion  model*    Instead,  It  Is  a  category  provided  In  the  framework 
In  which  to  describe  the  status  of  the  system  camponents  prior  to  the 
beginning  of  system  activities*    Thus,  there  Is  no  specific  time  at  which 
Initial  Conditions  begin*    The  category  Includes  all  relevant  processes 
and  outcomes  prior  to  Preparation,  which  begins  with  the  writing  of  the 
RFP  for  the  bilingual -PIP  study  (late  1974)* 

A  second  distinction  between  Initial  Conditions  and  the  other  four 
stages  Is  that  there  Is  no  '^Intended"  model  of  Initial  Conditions,  since 
the  "intention"  derives  from  the  system  planners  and,  by  definition,  does 
not  exist  prior  to  Preparation*    However,  there  can  be  discrepancies  be<* 
tween  the  perceived  Initial  Conditions  (as  understood  by  the  system  plan- 
ners) and  the  actual  Initial  Conditions,  and  some  Important  discrepancies 
of  this  type  are  Indicated  below* 

7*2*1*2    Major  features  and  problem  areas*    Initial  conditions  that 
affected  the  diffusion-system  outcomes  were  found  for  virtually  every  com*- 
ponent  of  the  PIP*-dlf fuslon*-8ystem  model  (Figure  7)*    Those  with  the  great*- 
est  Impacts  are  listed  In  Figure  9*  which  represents  the  Initials-Conditions 
column  from  Figure  7*    These,  as  well  as  other  relevant  Initial  conditions, 
are  discussed  In  the  narrative  that  follows* 

Note  that  the  status  of  the  PIPs  (the  central  components  of  this  dif- 
fusion system)  Is  described  under  LEA  materials,  reflecting  the  convention 


103 


Stage  Ot    Initial  Gondltlona  (7.2) 


USOE  (7.2,2) 

Peraouael  (7.2.2.1) 

•  Pre-exl&tlng  diffusion  goals 

•  Knowledge  of  PXP"-dlff u&lon^&y&tem  effectiveness 

•  Knowledge  of  target-LEA  characteristics 

Other  resources  (7.2.2.2) 

Plans  and  constraints  (7*2*2*3) 

•  Plans  for  the  compensatory-educatlon^PXP  diffusion  system 

•  Guidelines  for  selecting  exetoplary  projects 


Dlffusers  (7*2.3) 

Personnel  (7.2.3.1) 

•  Pre-existing  diffusion  organizations 

Other  resources  (7.2.3.2) 

•  Establlehed  funding  levels 

Plans  and  constraints  (7.2.3,3) 

•  Establlnhed  diffusion  approaches 


Target  LEAs  (7.2.4) 

Personnel  (7.2.4.1) 

•  Decision  makers 

*^    Informations-seeking  behavior 

"    Readiness  for  change 

-   Attitudes  toward  bilingual  programs 

•  Potential  project  staff  (skills  and  attitudes) 

Other  resources;    PIPs  (7.2.4.2) 

Plans  and  constraints  (7.2.4.3) 

•  Laws  and  regulations 

•  Existing  bilingual  programs  In  the  target  LEAs 

•  Exemplary  projects  potentially  available  for  diffusion 

Students  (7.2.4.4)  ^ 

•  Needs  deriving  from  lack  of  language  (and  other)  skills 


Figure  9.    Actual  PIP  diffusion  system;    Stage  0  key  Issues. 
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of  grouping  Other  Resources  (and  Plans  and  Constraints)  with  the  Personnel 
who  use  them  or  are  affected  by  them  rather  than  the  personnel  who  develop 
them*    Similarly*  the  projects  available  for  diffusion  are  described  under 
LEA  Flans  and  Constraints  because  the  ultimate  role  of  these  projects  in 
the  system  is  that  of  plans  or  guidelines  for  LEA  programs* 

7*2*2    USOE  Initial  Conditions 

7*2*2.1    USOE  personnel 

Pre-existing  diffusion  goals*    Prior  to  the  time  that  the  OPBE  began 
preparing  the  RFP  for  the  packaging  of  bilingual  projects  (late  1974) » 
Congress  and  USOE  planners  had  established  the  goal  of  assisting  LEAs  in 
implementing  effective  bilingual  programs;    ESEA  Title  VII  was,  of  course 
the  major  tangible  USOE  program  reflecting  that  goal*    Secondly,  there 
was  a  general  goal  of  capitalizing  on  the  successes  in  all  USOE  programs 
by  diffusing  the  most  effective  projects  and  practices  to  other  sites  that 
could  profit  from  them*    Thirdly,  there  was  an  interest  within  OPBE  in  the 
use  of  packaging  as  a  means  of  f acl.lirating  project  diffusion,  and  there 
was  the  closely  related  philosophy  that  effective  projects  should  be  pack- 
aged and  dissemlnat.^d  Intar.tt  t:lnce  there  was  no  practicable  way  of  deter- 
mining which  set  of  project  features  was  necessary  and  sufficient  for  suc- 
cess*   The  atten^pt  to  identify,  package,  and  diffuse  effective  bilingual 
projects  was  a  logical  result  of  these  goals  and  interests* 

Knowledge  of  PIP-diffuslon-system  effectiveness.    At  this  time  (late 
i974),  little  infonr^tion  about  project  diffusion  via  PIPs  was  actually 
available*    The  SRI/rmC  field  tryout  of  the  original  (compensatory  educa- 
tion) PIPs  had  just  begun*    Initial  results  were  positive,  but  there  were 
several  important  diffiirences  between  the  first  PIP  tryout  and  the  subse- 
quent, bilingual  PIP  field  test  that  were  not  yet  obvious.     In  particular: 
(a)  the  compensatory  projects  were  relatively  limited  in  scope,  with  well 
defined  instructional  treatments*    Most  were  pull-out  labs  that  operated 
fairly  autonomously  within  the  school  district,  while  the  bilingual  proj- 
ects involved  major  changes  to  the  existing  school  program;  (b)  by  and 
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large»  the  procedures  and  materlsls  of  the  compensatory  projects  were 
stable  as  compsred  to  procedures  and  materials  in  the  rapidly  evolving 
field  of  bilingual  education;  and  (c)  the  compensatory-project  field-test 
sites  were  given  Isrge  grants  conditional  cn  their  following  the  packaged 
projects  closely,  while  the  bilingual  sites  had  no  such  specific  condi- 
tions written  Into  their  Title  VII  grants.    However,  these  distinctions 
were  not  Included  In  the  reports  available  to  USOE  st  that  time. 

Knowledge  of  target^LEA  characteristics.  Some  of  the  key  charscter- 
Istlcs  of  the  target  LEAs  are  described  below  In  Section  7.2.4.  Individ- 
ual USOE  personnel  were  certainly  aware  of  these  characteristics  to  vary- 
ing degrees,  but  subsequent  planning  of  the  blllngual*-PIP  diffusion  system 
did  not  reflect  an  accurate,  comprehensive  understanding  of  the  needs  a:i.1 
resources  of  che  target-LEA  pool. 

7.2.2.2    Other  resources.    While  the  IfSOE  role  in  the  blUngual-PIP 
diffusion  effort  was  clearly  influenced  to  some  extent  by  the  availability 
(or  lack)  of  funds,  msterials,  and  facilities,  these  problems  were  outside 
the  scope  of  this  study.    It  seems  safe  to  speculate,  however,  that  the 
simple  sddltlon  of  such  resources  could  not  have  chsnged  the  resulta  of 
the  field  test  substantially. 

7.2*2.3    Plans  and  constraints. 

Plans  for  the  compensatory-educatlon^^PIP  diffusion  system.    'The  doml" 
Inant  factor  in  the  development  of  the  blllngusl-PIP  diffusion  system  wss 
the  set  of  pre-existing  PIP«dlf fusion  efforts  for  compensatory  education 
projects.    Although  the  plan  wss  modified  somewhat  for  the  blllngual-PIP 
diffusion  effort  (to  mske  use  of  the  TRCs),  in  the  terminology  of  the 
dlf fuslon^^system  model,  the  plans  and  guidelines  for  blllngual*"PIP  dlffu*" 
slon  were  "selected"  f^om  -he  '^ompe,  ^atory-educatlon-PIP-dlf fusion  plans 
and  guidelines,  rather  than  ^  -dvelopd''  specifically  to  meet  the  bilingual*^ 
project-'dlf fusion  goals.    Furthermore,  the  "selection"  process  spparently 
did  not  Involve  any  comparison  of  alternatives. 
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In  fact»  it  appeared  to  BMC  that  the  bilingual^PIP-dif fusion  system 
was  the  result  of  the  chance  conj  unction  cf  two  OPBB  research  efforts***^ 
(a)  the  BMC  and  PHI  PIP  studies*  and  (b)  the  AIR  search  for  exemplary  bi- 
lingual projects*    It  is  easy  to  see  ehae  the  initially  positive  results 
from  the  compensatory-proJect-PIP  tryout  and  the  existence  of  four  JDRP- 
validated  bilingual  projects  could  have  led  quite  naturally  to  the  bilingual* 
PIP  system*    Subsequently*  of  course,  this  and  other  diffusion  studies  have 
shorn  that  a  much  more  systematic  approach  to  planning  a  diffusion  system 
is  required  in  order  to  ensure  auccess* 

Guidelines  for  selecting  exemplary  projects*    Identification  of  ex- 
emplary bilingual  projects  was  already  in  prorress  in  1974-75 »  although 
formal  planning  of  the  diffusion  system  had        begun*    At  that  time» 
there  were  no  guidelines  as  to  what  project       tures  were  important  in  a 
package-based  diffusion  effort,  and  the  major  aelection  criterion  was  "con* 
vincing  evidence  of  positive  impact  on  student  achievement*"  ^ 

Within  this  context  of  preliminary)  incomplete  infoimationt  OPBE  pro- 
ceeded with  plans  to  package  exemplary  bilingual  projects  while»  at  the 
same  time»  monitoring  the  ongoing  compensatory-project  PIP  field  test  for 
information  that  could  be  relevant  to  the  later  dissemination  of  the 
bilingual  packap 

7*2*3    Initial  Conditions  cf  Diffusers 

7*2*3*1    Diffusion  peraonnel  (preexisting  diffusion  organizations)* 
Concurrently,  QBE  was  developing  the  system  of  aupport  centers  for  ESEA 
Title  VII  projects*    The  TRCs  were  one  of  three  types  of  centers  in  the 
support  system  and  were  eo  focus  on  technical  assistance  to  LEAs*  while 
the  other  two  types  were  developing  and  disseminating  instructional  mate- 
rials*   Thu3»  QBE  had  a  dissemination  system  in  place  at  the  time  the  de- 
velopment of  the  bilingual  PIPs  was  begun»  although  there  was  little  or 
no  coordination  between  the  development  of  the  QBE  system  and  the  PIP 
development  etfort*    Furthermore*  the  TRC  personnel  were  neither  familiar 
with»  nor  always  receptive  to,  the  PIP  diffusion  concepts* 
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At  the  same  tiine»  other  formal  and  informal  dlBBemination  BystemB 
were  operating  independently  of  USOE*    These  Bystems  were  operated  by 
state  bilingual  officeB»  professional  organizations »  commercial  publishers* 
and  LEAs  themselves*    In  addition*  the  Office  of  Civil  Rights  (OCR)  and 
^he  Lau  Centers*  while  not  disseminating  instructional  practices  per  set 
were  having  a  major  impact  on  directly  relevant  administrative  and  organi- 
zational features  in  some  LEAs  (i*e*»  desegregation  of  schools  and  estab- 
lishment of  bilingual  programs}*    From  the  perspective  of  the  LEAa»  the 
new  Title  VII  system  was  only  one  of  many»  and  not  necessarily  the  domi- 
nant one* 

i*2*3*C    Other  resources  (established  funding  levels)*    The  dominant 
initial  condition  under  this  heading  was  the  established  funding  level  for 
the  TRCs*    The  absolute  level  of  funding  was  not  important  to  the  diffusion 
questions^  but  the  fact  that  a  level  had  been  fixed  and  that  activities 
conaistent  with  that  level  had  been  planned  was  to  affect  the  capabilities 
of  the  TRCs  to  respond  to  the  PlP^^dif f usion*syst^  requirements* 

7*2*3*3    Plans  and  constiraints  (established  diffusion  approaches)* 
As  was  the  case  with  funding  levels*  plans  and  guidelines  for  diffusion 
activities  had  been  established  by  all  TRCs  before  the  PIP  diffusion 
effort  was  initiated*    These  plans  were  not  necessarily  compatible  with 
the  PIP  diffusion  approach  that  was  subsequently  provided  by  USOE* 

7*2*4    Initial  Conditions  in  Target  LEAs 

Overview*    The  pool  of  LEAs  relevant  to  this  discussion—those  with 
existing  bilingual  projects  and  those  potentially  requiring  such  projects 
—was  not  well  understood  (see  Questions  2  and  4  in  Figure  8)*    There  ap- 
peared to  be  a  tacit  assumption  among  USOE  personnel  and  throughout  the 
community  of  bilingual  educators  that  a  few  sites  had  developed  exemplary* 
effective  projects  while  most  others  had  less  effective  projects  or  none 
at  all*    In  retrospect*  it  now  appears  that  this  percept^.on  was  inaccurate 
in  two  Important  respects* 

First*  like  programs  in  other  fields*  the  most  effective  bilingual 
programs  (as  distinguished  from  projects)  were  probably  having  much  less 
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Impact  on  student  achievement  than  the  existing  evaluation  reports  had 
led  the  educational  community  to  believe  (see  Section  3*2*5,  Problems  with 
LEA  Evaluation  Reports,  and  Volume  III,  Appendix  A,  How  Big  Are  Achieve- 
ment Gains?)*    Second,  by  and  large  it  appears  to  have  been  the  "contexts" 
fi*e.,  the  teachers,  students,  LEA  decision  makers,  parents,  and  community) 
that  were  the  dominant  factors  in  program  effectiveness  rather  than  the 
"projects"  (i*e*,  instructional  methods  and  materials,  organization,  and 
so  on)*    Taat  is,  since  we  know  that  even  substantial  changes  in  classroom 
techniques  have  rather  small  impacts  on  student  achievement,  and  since  the 
exemplary  projjrams  included  few,  if  any,  unconventional  instructional  ap- 
proaches, it  is  fairly  aafe  to  conclude  that  the  effective  programs  were 
the  result  of  the  competent,  enthusiastic  application  of  conventional  bi* 
lingual  approaches  rather  than  of  the  development  of  new,  more  effective 
approaches  to  teaching*    Thus,  while  the  LEAs  with  less  effective  programs 
(or  none  at  all)  had  a  great  deal  to  learn  from  the  effective  programs, 
much  of  the  information  consisted  of  how  the  effective  programs  had  ap- 
plied widely  known  management  and  bilingual  instructional  approaches  to 
meet  their  local  needs*    Little,  if  any,  information  on  unique  or  inno- 
vative approaches  was  available* 

An  additional  set  of  factors  that  subsequently  had  a  major  impact 
on  the  bilingual"'PIP  diffusion  system  involved  the  heterogeneous  nature 
of  the  target  LEA  pool*    Of  course,  no  two  LEAs  were  exactly  alike,  and 
there  were  many  dimensions  on  which  they  differed,  but  from  a  diffusion 
perspective,  three  of  these  dimensions  ware  especially  important;  (a) 
language  (Spanish  or  French);  (b)  i[}fomation*-seeking  behavior  (active 
or  passive);  and  (c)  previous  >ji lingua l*-prog tarn  experience  (extensive  or 
limited)* 

All  of  these  dimensions  are  discussed  elsewhere  in  this  report*  The 
point  to  be  made  here  is  that  even  this  very  rough  breakdown  (into  three 
dimensions  with  two  values  apiece)  defines  eight  categories,  each  of  which 
requires  a  different  diffusion  approach*    Furthermore,  the  nuniber  of  LEAs 
in  each  category  is  an  Important  factor  in  determining  the  most  cost- 
effective  iipproach  to  diffusion*    If,  for  example,  there  were  only  a  few 
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experiencedi  French-language  LEAs  actively  seeking  new  informationi  it 
might  be  more  cost**ef  fective  to  organize  a  conference  or  series  of  advanced* 
level  workshops  than  to  spend  several  yea^c  developing  and  field-testing 
costly»  stand-alone  packages* 

The  information  about  the  basic  differences  a*nong  target  LEAs  was, 
of  course,  available  during  the  initial  conditions  stage*    The  importance 
of  considering  the  target  LEA  pool  as  a  set  of  distinct  subgroups,  each 
requiring  a  different  diffusion  approach,  was  noZ  as  obvious  and  was  not 
reflected  in  the  experimental  diffusion  effort* 

7*2*4*1    Taraet-LEA  Personnel* 

Decision  makers*    The  attitudes  of  the  local  decision  makers,  espe- 
cially their  motivations  to  adopt  bilingual  projects  and  their  attitudes 
toward  change,  are  critical  factors  in  the  success  of  a  diffusion  system* 
It  was  clear  from  f ield*test-site  reports  that  the  potential  adopter  LEAs 
varied  widely  in  their  motivations  for  adopting  bilingual  projects*  All 
were  subject  to  pressure  from  federal  court  decisions*    Many  needed  to  meet 
&tate  requirements*    Many  were  also  subject  to  local  pressures  (for  or 
against  bilingual  education)  from  parents  and  community  and  from  within 
the  LEA*    The  availability  of  Title  VII  funds  was  an  Incentive  or  facili- 
tating factor  for  many  LEAs*    However,  local  educators  generally  believed 
that  their  situations  were  largely  unique  to  their  own  districts,  and  no 
evidence  was  found  in  this  study  of  any  interest  in  precise  replication  of 
exemplary  projects  from  other  districts* 

Information  on  attitudes  toward  change  (i*e*,  introducing  bilingual 
programs  or  modifying  existing  programs)  was  not  collected  from  the  entire 
pool  of  target  LEAs,  but  it  was  clear  from  TRC  records  and  interv.  -"ws  with 
TRC  staff  that  the  LEAs  differed  widely  in  the  types  and  the  amounts  of 
information-seeking  behavior  they  exhibited*    The  implication  was  that 
many  of  the  LEAs  with  the  greatest  needs  for  new  or  Improved  programs 
were  not  disposed  to  seek  out  information  ovi  exemplary  projects  or  to 
respond  actively  to  a  PIP-type  awareness  effort* 
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Potential  project  staff*    The  major  resources  required  for  Implement- 
ing bilingual  programs  were  skilled  management  and  bilingual  teaching 
stafft  and  these  personnel  were  In  short  supply  throughout  the  pool  of 
potential  adopters*    Both  language  skills  and  bilingual-program  experience 
were  scarce^  although  they  were  available  at  some  sites  as  will  be  seen 
below* 

Attitudes  of  potential  project  staff  members  also  varied*    Many  poten- 
tial project  directors  and  bilingual  teachers  were  actively  Interested  In 
bilingual  programs  or  were  receptive  to  the  Idea  when  It  was  presented^ 
but  there  were  (and  are)  enough  school  personnel  who  oppose  bilingual  pro- 
grams to  njake  this  an  Important  factor  for  diffusion  system  planners  to 
consider* 

7*2*4*2    Other  resources  (PIPs)*    This  section  describes  the  back-* 
ground  of  PIP-type  packaging*    Of  course^  the  PIPs  were  not  the  only  "other 
resources"  relevant  to  the  PIP-dlf fusion  effort*    The  lack  of  adequate 
tests  was  also  a  major  problem^  but  this  Issue  is  discussed  '"nder  Substudy 
II*    Some  problems  also  resulted  from  the  lack  of  Instructional  loaterlals 
or  facilities  available  to  various  field-test  sl'.es  but»  by  and  large^ 
these  were  secondary  Issues*    It  was  *      preexisting  concept  of  PIP-type 
packaging  that  was  the  major  factor  In  determining  the  nature  of  the  PIP- 
dlf  fusion  effort* 

The  background  presented  here  Is  only  that  related  to  the  PIP  pack- 
aging and  diffusion  concepts*    The  background  relating  to  the  contents  of 
the  PIPs  (l*e*>  to  the  Identification  of  projects  for  packaging  and  dif- 
fusion) Is  described  below  under  Plans  and  Constraints* 

PIP  concepts*    In  attempting  to  diffuse  exemplary  projects,  USOE  has 
pursued  two  approaches*    One  has  been  to  fund  the  project  developer  to 
work  as  a  consultant  to  adopter  sites*    The  second,  packaging,  has  been 
an  attempt  to  find  a  more  cost-effective  alternative*    It  was  reasoned 
that  If  exemplary  projects  were  carefully  analyzed,  and  how-to-do-lt 
manuals  were  prepared  presenting  the  essential  features  cf  the  projects^ 
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then  adopter  filtes  might  be  able  to  replicate  the  projects  faithfully  with 
very  little  technical  BBsistance*    Although  a  wide  variety  of  projects  had 
been  described  in  an  equally  wide  variety  of  publications  under  both 
private  and  govemment  sponsorahipi  the  initial  KMC  PIP  contract  was  the 
first  attempt  by  USOE  to  develop  materials  that  were  comprehenciive  enough 
to  stand  alone  in  supporting  an  adoption  (aee  the  Overview  of  the  Seven 
USOE  PIP  Studies,  Section  1*3)* 

The  basic  PIP  concepts  that  predated  the  bilingual  PIP  development 
were  (a)  stand-alone  packages,  (b)  whole-'project  adoption,  and  (c)  rapid 
start-up*    The  atand-^slone-packaging  concept  was  always  qualified  by  USOE 
personnel,  who  recognized  from  the  beginning  thst  aome  technical  assistance 
would  always  be  needed*    Whole-project  adoption  is  discussed  below  under 
"Project  Selection*'* 

The  concept  of  rapid  start-^up  was  a  fundsmental  PIP  principle  in  the 
sense  that  the  purpose  of  diffusing  existing  projects  was  to  provide  an 
alternative  to  the  slow  process  of  reinventing  simllsr  programs  In  each 
LEA*    However »  the  specific  spproach  to  start-up  and  the  PIP  emphasis 
on  start-up  activities  evolved  as  KMC  developed  the  first  prototype  and 
revised  compensatory*education  PIPs*    This  start-up  spproach  was  tailored 
to  the  characteriatic3  of  the  compensatory*education  projects  which,  as 
will  be  seen,  were  quite  different  from  the  bilingual  projects* 

PIP-development  time  achedule*    The  original  six  PIPs  were  prepared 
by  KMC  in  prototype  form  during  the  1973-1974  school-year*    During  the 
following  two  years,  the  prototypes  were  tried  out  in  19  sites  and  eval- 
uated by  SRI  International  (Stearns,  1975)  with  KMC  as  subcontractor*  The 
information  obtained  during  the  first  yesr  cf  the  tryout  was  used  during 
the  second  year  by  KMC  to  redesign  and  r^nrite  the  PIPs* 

As  can  be  seen  in  Section  1*3,  the  time  aequence  of  the  various  PIP 
studies  was  an  iiaportant  factor  in  determining  the  form  of  the  bilingusl 
PlPa*    The  identification  of  the  four  bilingual  projecta  took  place  during 
the  first  year  of  the  prototype-compensatory-education-PIP  field  test* 
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The  actual  development  of  the  bilingual  PIPs  coincided  with  the  revision 
of  the  prototype  PIPs*    Thus»  although  we  treat  the  existence  of  the  re- 
vised PIP  format  as  an  initial  condition  that  predated  the  preparation 
stage  of  the  bilingual-PIP-dif fusion  effort^  strictly  speaking  the  revised 
PIP  model  did  not  exist  at  the  time  that  CKMREL  visited  the  developer 
sites  for  the  bilingual  projects^  and  this  format  was  not  adopted  until 
after  preliminary  drafts  of  the  CEMREL  packages  had  been  completed*  This 
led  to  inconsistent  levels  of  detail  within  the  PIPs»  since  CEMRHL's  in- 
formation was  incomplete  for  some  sections  of  the  PIP  manuals* 

The  PIP  forma ^      The  bilingual  PIPs>  like  the  revised^  compensatory- 
education  PIPs»  each  consisted  of  a  set  of  manuals*      In  general^  a  dif- 
ferent manual  was  orepared  for  each  type  of  project  staff  member:  project 
director^  teacher^  instructional  consultant^  evaluator^  and  so  on*  Since 
staff  positions  differed  from  one  project  to  the  next»  the  sets  of  manuals 
also  differed  somewhat*    In  all  the  PIPs»  however^  the  key  manual  was  the 
Project  Management  Directory^  which  was  designed  for  use  by  the  project 
director*    A  typical  Project  Management  Directory  was  about  17S  p^ges  long 
with  the  following  table  of  contents: 


Chapter 

1: 

Project  Overview 

Chapter 

2: 

Using  the  PIP 

Chapter 

3: 

Management  Approach 

Chapter 

4; 

Communicating  with  School  and  Community 

Chapter 

5: 

Continuing  Beyond  the  First  Year 

Chapter 

6: 

Budget 

Chapter 

7: 

Selecting  Students 

Chapter 

8: 

Classroom  Implementation 
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9: 

Selecting  Staff 
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10: 

Staff  Development 

Chapter 

11: 

Staff  Relationships 

Chapter 

12: 

Materials /Equipment 
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Facilities 
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Each  chapter  liated  the  relevant  project  x^nla  and  the  asaociated 
taska  for  the  project  director^  then  provided  a  narrative  diBcuBsion  c£ 
the  topic»  illustrated  with  occasional  charts  or  forms  from  the  developer 
site. 

Manuals  for  all  other  ataff  members  retained  the  ssme  format  as  the 
Project  Manag^ent  Directory  but  were  generally  ahorter  in  length  and 
restricted  to  the  topica  moat  relevant  to  the  target  audience.    In  prin* 
ciple»  each  staff  member  was  intended  to  have  a  peraonal  copy  of  an  appro- 
priate manual.    Within  each  PIP»  aome  of  the  aame  information  waa  repeated 
in  two  or  more  manuala  (e.g.*  the  Project  Overview).    However*  in  order 
to  find  all  of  the  information  in  the  PIP,  it  would  be  neceaaary  to  read 
all  of  the  manuala  and,  for  this  reason,  the  project  director  was  intended 
to  have  a  complete  set. 

In  general,  the  Plpa  did  not  include  curriculu       ^erials.  Rather* 
the  projects  relied  heavily  on  commercial  niaterials*  and  the  Pips  listed 
the  .materials  and  described  hou  to  order  them.    In  some  caaes*  however, 
locally  made  materiala  played  a  major  role  in  the  developer  sites,  and 
some  of  these  materials  were  reproduced  for  inclusion  in  the  pIPs. 

PIP  awareness  and  aelection  materiala.    Awareness  and  selection  ma- 
teriala  were  also  prepared.    These  materials  included: 

•  An  Analysis  and  Selection  Kit  (ASK)  conaisting  of  an  overview 
brochure  containing  brief  descriptiona  of  all  projects*  a 
booklet  to  be  used  as  a  guide  to  selecting  among  the  projects* 
and  individual  project-deacription  booklets.    The  booklets 
were  packaged  in  a  plastic  bag. 

•  A  set  of  criteria  checklists  and  budget  worksheeta  designed  to 
assist  LEAs  in  evaluating  the  feasibility  of  Implementing  a 
apecific  PIP  project. 


•  A  set  of  project  orientation  materials  including  posters,  leaf- 
lets, and  plans  for  orientation  meetings.    These  materials  were 
designed  to  aid  potential  adopters  in  securing  the  support  and 
commitment  of  school  and  community  persons  for  the  selected 
project. 

•  A  set  of  materials  for  disseminators,  including  suggestions  for 
promoting  the  projects,  offering  technical  assistance  to  LEAs, 
and  monitoring  project  start-up  and  implementation. 

7.2.4.3    LSA  plans  and  constraints.    There  are  three  kinds  of  system 
component's  that  fall  in  this  category  and  for  which  the  initial  conditions 
had  a  major  impact  on  the  PIP-dif fusion  effort.    These  were:    (1)  laws  and 
regulations;  (b)  existing  bilingual  programs  in  the  target  LEAs;  and  (c) 
exemplary  projects  potentially  available  for  diffusion.    Laws  and  regula** 
tions  (local,  state,  and  federal)  constrained  field-test  sites  in  a  vari* 
ety  of  ways.    Many  target  LEAs,  including  most  of  the  field-test  sites, 
had  already  implemented  some  forms  of  projects  for  students  with  limited- 
English  proficiency,  and  these  projects  heavily  influenced  the  PIP-project 
adoptions.    The  specific  influences  of  these  laws,  regulations,  and  estab- 
lished programs  are  discussed  under  the  subsequent  stages.    However,  the 
exemplary  projects  available  for  adoption  were  at  least  equally  important 
in  determining  the  results  of  the  bilingual^PIP  diffusion  effort,  and  the 
approach  to  selection  constituted  a  key  initial  condition  for  this  effort. 

While  there  have  been  many  attonpts  to  identify  exemplary  projects 
over  the  years,  the  bilingual  PIPs  can  probably  be  traced  most  directly 
to  a  USOE^sponsored  study  by  AIR  (Hawkridge,  D*  G.,  Chalupskey,  A*  B., 
and  Roberts,  A.  0.  H.,  1968).    This  study  was  presumably  motivated  by  the 
feeling  that  at  least  some  federally  supported  projects  developed  in  local 
school  districts  were  dramatically  effective  and  that,  since  many  other 
federally  funded  projects  were  clearly  not  living  up  to  expectations,  it 
behooved  the  government  to  identify  the  successful  ones  and  make  their 
approaches  available  to  all. 
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In  this  and  subsequent  AIR  BearcheB^  the  focus  was  on  projects  for 
the  educationally  disadvantaged >  with  a  major  emphasis  on  ESEA  Title  I 
projects*    Over  a  period  of  several  years»  AIR  found  two  dozen  or  more 
projects  that  met  their  criteria  of  effectiveness*    Some>  though  not  all> 
of  these  were  reconfirmed  as  exemplary  In  follow-up  studies*    USOE  consi- 
dered the  results  of  the  searches  positive  enough  to  justify  an  effort 
to  diffuse  successful  projects  to  other  Interested  LEAs* 

Additional  searches  using  revlsf'.d  criteria  were  carried  out  In  order 
to  select  projects  for  diffusion  via  PIPs*    The  first  BMC  PIP  study  Iden^ 
tlfled  six  projects  for  educationally  disadvantaged  students  (Tallmadge^ 
1974)*    Subsequently^  CEMREL  Inc*  of  St*  Louis  Identified  and  packaged 
six  more  such  projects*    Concurrently >  AIR  had  conducted  a  search  for  ex- 
emplary bilingual  projects  (Campeau>  et  al*>  1975)^  and  It  was  four  proj** 
ects  Identified  In  this  study  that  were  subsequently  packaged  by  CEMREL 
as  the  bilingual  PIPs* 

Validation  of  project  effectiveness*    In  the  meantime^  an  additional 
consideration  had  been  added  to  the  Identification  process*    USOE  had  es- 
tablished the  Dissemination  Review  Panel  (DRP)  In  1973  to  review  the 
evidence  of  effectiveness  for  all  projects  to  be  disseminated  under  USOE 
sponsorship*    1\1E  subsequently  joined  In  the  review  process  and  the  Joint 
Dissemination  Review  Panel  (JDRP)  was  formed* 

The  Immediate  Inpact  of  the  DRP/JDRP  wae  to  require  all  candidates 
for  exemplary  project  status  to  prepare  somewhat  more  carelrul  evaluation 
reports.    From  a  dissemination  vlevpolnt»  there  were  three  Important 
results,    Flrstj  JDRP  review  became^  In  effect^  the  major  USOE  review 
process  for  project  selection.    Second^  since  Impact  on  student  achieve^ 
ment  waa  a  major  criterion  for  JDRP  approval^  and  since  few  projects  can 
demonstrate  such  gains,  evidence  of  achievement  gains  became  the  dominate 
Ing  criterion  for  selection  in  the  AIR  (and  RMC)  search.    Finally,  since 
the  JDRP  could  not,  In  general,  determine  which  parts  of  a  project  pro^ 
duced  Its  alleged  benefits  to  students »  USOE  adopted  a  policy  of  dissemi- 
nating JDRP^approved  projects  Intact*    Adopter  sites  were  expected  to 
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adopt  all  of  the  project  If  they  were  to  receive  federal  support  for 
their  adoption.    JDRP  approval  was  a  key  criterion  In  the  selection  of 
projects  for  PIP  packaging,  and  the  concept  of  whole-^project  adoption 
was  central  to  the  PIP  design. 

Tvo-^language  versus  multiple* language  projects.    This  study  did  not 
Include  a  survey  of  available,  exemplary  projects  beyond  those  packaged 
In  the  PtPs.    Those  four  projects  are  described  under  the  Preparation 
stage,  below.    However,  one  Important  distinction  that  came  up  repeatedly 
In  Informal  discussions  during  the  study  can  be  noted  here.    This  Is  the 
distinction  between  two- language  projects  and  multiple* language  projects. 
All  of  the  PIP  projects  fell  Into  the  former  category.    That  Is,  the  proj* 
ects  applied  either  to  LEAs  ^ere  English  and  Spanish  were  the  only  lan^ 
guages  spoken,  or  to  LEAs  where  English  and  French  were  the  only  languages 
spoken.    Analogous  projects  exist  for  a  variety  of  other  languages,  and 
these  projects  share  many  features  that  are  Independent  of  the  specific 
language  Involved. 

A  quite  different  problem  Is  presented  where  many  different  languages 
are  found  In  a  single  school,  often  Including  several  Asian  languages  and 
several  European  languages.    In  some  cases,  the  blllngual-'program  students 
are  primarily  new  arrivals  who  may  speak  no  English  at  all.    While  such 
LEAs  appesr  to  represent  an  Important  part  of  the  target^LEA  pool,  their 
needs  are  not  addressed  by  the  typ«±s  of  projects  described  In  the  four 
blllngusl  PIPs.    Although  a  search  for  exemplary,  multiple^ language  pro*- 
grams  was  beyond  the  scope  of  this  study,  the  experience  of  the  KMC  staff 
suggests  that  the  pool  of  such  projects  Is  not  large. 

7.2.4.4    Target  students.    The  final,  and  ultimately  most  Important, 
component  of  th3  systm  Is  the  student  population.    Target  LEAs  outside 
of  the  19  fleld^test  sites  were  rot  studied  here,  but  students  In  the 
fleld*test  sites  probably  represented  much  of  the  range  In  the  total 
target*LEA  pool.    The  generalization'*  below  are  based  on  the  reports  of 
teachers  and  project  directors  as  well  as  on  observations  made  by  KMC 
staff  during  site  visits  and  on  test  scores  from  the  LEA  evaluation  re** 
ports. 
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In  order  to  describe  the  general  nature  of  the  students  being  served, 
it  is  essential  to  view  the  Spanish- English  projects  separately  from  the 
French- English  projects^  With  the  exception  of  Puerto  Rico,  the  linguistic 
characteristics  of  the  students  being  served  in  all  of  the  Spanish-English 
sites  were  comparable  to  those  of  the  originating  sites^    Many  of  these 
students  came  from  homes  where  only  Spanish  was  spoken,  while  some  came 
from  bilingual  home  environment s^    In  one  of  the  fifteen  Spanish-English 
sites,  the  number  of  such  pupils  was  small  relative  to  the  total  number  of 
students  in  the  project f    In  some  sites,  most  project  students  appeared 
to  be  more  comfortable  in  Spanish  while  in  others,  English  was  preferred, 
especially  by  second-grade  students.    In  Puerto  Rico,  of  course,  all  of 
the  students  were  Spanish  speaking,  and  English  was  taught  as  a  foreign 
language.    In  the  four  French-English  sites,  the  students  were  not  fluent 
in  French  although  French  was  spoken  in  some  homes^    In  at  least  15  sites, 
the  target  studenta  were  generally  underachieving,  in  some  cases  substan- 
tially SO4    These  characteristics  of  the  students  affected  the  nature  of 
the  programs  that  were  implemented,  and  also  affected  the  interpretation 
of  Impact  evaluations  (Sections  9-13  of  this  voluTne)^ 

7*2.5    Summary  of  Status        Problems:    Initial  Conditions 

The  description  of  initial  conditions,  above,  focuses  on  the  problem 
areas  facing  the  bilingual-PIP-dif fusion-system  planners  at  the  time 
active  planning  and  preparation  began.    The  major  problem  areas,  as  seen 
in  retrospect,  are  summarized  below. 

7.2.5.1    USOE.    The  syst^  planners  from  USOB  brought  to  the  planning 
task  (a)  a  goal  of  diffusing  intact,  exemplary  projects,  (b)  an  approach 
to  selecting  projects  for  diffusion,  and  (c)  an  experimental,  PIP-based 
delivery  system.    Ijow,  six  years  later,  it  is  clear  to  RMC  that  the  goal 
of  diffusing  intact,  exemplary  projects  is  appropriate  only  for  limited 
types  of  projects  and  is  inappropriate  for  bilingual  projects.    The  ap- 
proach to  selecting  exemplary  projects,  which  relied  heavily  on  apparent 
achievement  impacts  and  did  not  separate  project  effects  from  context 
effects,  bas  also  proven  to  be  inappropriate.    Finally,  the  PIP-based 
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delivery  system^  with  its  heavy  reliance  on  packaging^  has  not  proven  to 
be  well  suited  to  bilingual  programs  or  to  the  needs  of  the  target  LEAs* 

However^  this  information  was  not  available  during  the  period  we  have 
labeled  ^'Initial  Conditions***    The  concept  of  exemplary  programs  was  widely 
accepted  in  the  educational  vorld;  the  approach  to  selection  of  projects 
was  also  widely  accepted^  and  the  PIP  concept^  though  subject  to  widespread 
skepticism^  had  proven  remarkably  effective  in  early  tryouts*  Furthermore, 
the  entire  field  of  bilingual  education  was  in  a  state  of  dynamic  develop^ 
ment»  and  it  is  not  surprising  that  the  needs  and  resources  of  the  target 
LEAs  were  not  well  understood*    Finally,  USOB  had  not  developed  any  sys- 
tematic approach  to  planning  large-scale  diffusion  efforts*    Thus,  it  is 
not  surprising  that  there  were  problems  with  the  experimental  PIP-dif fusion 
efforts* 

7*2*5*2    Diff users*    The  PIP  diffusion  agencies^  in  particular  the 
TKCst  were  new  and  essentially  untried*    While  their  diffusion  activities 
were  still  in  a  stage  of  development »  these  activities  did  not  include 
the  use  of  PIFs»  and  some  of  the  TRCs  were  not  receptive  to  the  PIP  con- 
cept*   Furthermore  TRC  budgets  were  fixed  without  provisions  for  PIP- 
diffusion  activities*    Thus,  the  TRCs  were  not  in  a  position  to  contribute 
major  technical  support  services  to  the  PIP  delivery  system* 

7*2*5*3    Target  LEAs*    The  target  LEAs  varied  widely  in  terms  of 
student  needs,  motivations  to  adopt  bilingual  programs^  experience  with 
such  programs^  information^^seeking  behavior,  and  availability  of  appro- 
priate staff*    Thus  no  single  approach  could  be  expected  to  be  appropriate 
for  all  target  LEAs* 

The  obvious  solution  would  be  to  categorize  LEAs  according  to  relevant 
characteristics  for  the  purpose  of  planning  different  diffusion  approaches* 
However-i  the  number  of  LEAs  in  a  category  would  then  become  a  major  factor 
affecting  the  diffusion  approach*    That  is>  an  approach  that  might  be  cost"" 
effective  for  a  large  group  of  LEAs  might  not  be  cost-effective  for  a 
smaller  group* 
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7*3    Stage  1:  Preparation 


7.3*1  Overview 

7*3*1*1    Definition  of  Stage  1*    The  preparation  stage  Is  Intended 
to  Include  all  activities  related  to  the  development  of      ?t  PIP*dlf fusion 
system  prior  to  the  actual  dissemination  of  awareness  materials  to  the 
sites*    We  nave  defined  the  stage  as  beginning  with  the  selection  of  proj- 
ects for  packaging  (Study  3,  1974-1975}  although.  In  fact»  the  selection 
contract  was  relatively  Independent  of  the  other  packaging-Investigation 
studies*    The  stage  continues  through  the  briefing  of  TRC  personnel  on 
their  required  PIP-dlf fusion  activities  (Kc/ember  1976)* 

7*3*1*2    Major  features  and  problem  areas*    The  major  activities  of 
the  preparation  stage  were  (a)  selecting  the  four  exemplary  bilingual 
projects^  (b)  de, 'sloping  the  four  PIPs,  and  (c)  training  the  TRCs  for 
their  role  In  the  diffusion  system*    The  results  of  tnese  and  other  rele- 
vant activities  are  organl2ed  according  to  the  major  headings  of  the  PIP 
diffusion  model,  as  shown  In  Figure  10* 

7*3*2    USPS  Preparation 

7*3*2*1  Personnel* 

DeflninR  explicit  Roals*    The  general  USOE  goals  were  described  under 
Initial  Conditions  (7*2*2*1)*    In  retrospect,  It  sppears  to  BMC  that  a 
desirable  first  step  in  developing  the  diffusion  system  would  have  been 
to  refine  these  goals  into  explicit  statements  that  could  have  guided  the 
design  and  implementation  of  the  system.    A&  noted  under  subsequent  stage'^, 
conflicts  among  different  goals,  especially  between  the  research  goals  a. :! 
th^  goals  of  serving  the  LEAs,  produced  a  certain  amount  of  confrision  as 
to  how  much  adaptat.^.on  of  the  PIP-de£ioed  projects  was  permissible* 

A^f^lyg^-lnjj  exemplary  prcjecc^i  and  target  LEAs*    A  second  important 
activity  . /e  been  for  USOE  personnel  to  Inform  themselves  in  more 
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 Stage  1;    Preparation  (7.3)  

USQE  (7.3.2) 

Personnel  (7.3.2.1) 

•  Defining  explicit  goals 

•  Analyzing  exemplary  projects  and  target  LAs 

•  Training  for  diffusion  tasks 

Other  resources  (7.3.2.2) 

Plans  and  cor^traints  (7.3.2.3) 

•  Plans  for  USOE  participation  in  the  diffusion  effort 


Diff users  (7.3.3) 

Personnel  (7.3.3.1) 

•  Selection  of  diffusion  personnel 

•  Training  of  TRC  personnel 

Other  resources  (7.3.3.2) 

•  Funds  and  materials 

Plans  and  constraints  (7.3.3.3) 

•  '^he  USOE-deve loped  diffusion  plan 


Target  LEAs  (7.3.4) 

Personnel  (7.3.4.1) 

•  Capacity  building 

Other  resources  (7.3.4.2) 

•  Development  of  the  PXPs 

Plans  and  constraints  (7.3.4.3) 

•  Selection  of  the  projects 

Students  (7.3.4.4) 

•  Ho  activities  during  preparation 


Figure  10.   Actual  PIP  diffusion  system:    Stage  1  issues. 
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depth  as  to  the  characteristics  of  projects  available  for  diffusion  and 
the  neeci3  Bid  resources  of  the  target  LEAs*    The  many  negative  consequences 
of  not  conducting  this  kind  of  "market  research"  are  discussed  throughout 
this  report* 

Training  for  diffusion  tasks*    Preparation  for  USOE  staff  was  about 
at  the  same  level  as  for  TRC  personnel »  deacrlbed  below*    According  to 
plan^  as  soon  aa  grants  were  awarded^  OBE  Program  Officers  were  to  take 
over  from  the  TRCs  as  the  main  USOE  contacts  for  LEAs*    TRCs  were  to 
continue  to  provide  training  support*    Like  the  TRC  personnel*  the  OBE 
program  offlcera  became  familiar  with  the  PXP  materials  and  the  projects 
they  described  but  did  not  do  an  In-depth  analysis  of  project  features 
and  were  not  trained  to  provide  technical  support  on  program  implementa- 
tion* 

7*3*2*2    Other  resources*    No  major  Issues* 

7*3*2*3    Plans  and  constraints*    General  plans  for  the  activities  of 
USOE  personnel  in  the  diffusion  effort  were  prepared  by  OPBE  and  OBE^  and 
It  becomes  a  value  Judgment  as  to  whether  more  formal  or  more  elaborate 
plans  were  called  for  in  what  was  clearly  an  exploratory  effort*  Certainly^ 
problems  arose  that  could  have  been  eliminated  by  more  thorough  planning;  ^ 
and  we  would  assume  that  more  effort  would  go  into  the  planning  of  a  larg^- 
scale»  operational  system*    However*  in  RMC's  judgment*  the  plans  (or  lack 
of  plans)  covering  the  activities  of  USOE  personnel,  while  they  contributed 
to  some  of  the  problems  described  under  selection/adoption,  start-*up,  and 
operation,  were  not  critical  factors  in  the  success  or  failure  of  the  dlf^ 
fusion  system* 

7*3*3    Preparation  of  Dlffusers 
7*3*3*1  Personnel* 

Selection  of  diffusion  personnel*    A,ltbough,  to  RMC's  knowledge, 
there  were  no  fomial  plans  for  selecting  diffusion  personnel,  the  implicit 
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intienticn  was  to  find  diffusers  who  would  promote  awareness^  help  LEAs 
in  project  selection^  and  provide  technical  assistance  as  required.  The 
TRCs»  having  been  recently  established  as  the  OBE  technical  assistance 
centers  were  an  obvious  choice . 

The  decision  to  use  the  TRCs  was  consistent  with  the  approach  in  the 
parallel^  compensatory-education-PIP  diffusion  effort  which»  at  that  tiine^ 
was  contracting  with  professional  diff'ision  groups  (labeled  "diffusion 
contractors")  to  provide  awareness  and  tbr!hnical  assistance  activities. 
It  should  be  noted»  however^  that  the  diffusion  contractors  were  used  as 
a  temporary  system,  and  that  subsequently  the  compensatory- education  PIPs 
have  been  disseminated  by  the  National  Diffusioi  Network  (NDN),  with  tech- 
nical assistance  provided  by  the  developer  sitej.    The  bilingual-project 
developer  sites  were  not  involved  actively  in  tie  bilingual-PIP-dif fusion 
field  te&t,  nor  were  SEA  or  other  establi^^hftd  ^'iiffusion  groups  included 
in  any  formal  sense.    Given  the  exploratory  tiature  of  the  field  test,  it 
is  not  surprising  to  BMC  that  the  nominal  dissemination  and  technical 
assistance  responsibilities  were  restricted  to  the  TRCs.    However,  as  will 
be  seen  in  the  discussions  of  the  following  stages,  the  actual  diffusion 
process  was  heavily  influenced  by  persons  outside  of  the  TRCs. 

Training  of  TRC  personnel.    Training  of  the  TRC  personnel  for  PIP 
diffusion  was  minimal.    The  first  eight  TRCs  began  operation  in  1975-76, 
the  same  year  that  the  bilingual  PIPs  were  developed.    Seven  more  TRCs 
began  operation  in  1976-77,  the  year  of  the  bilingual-PIP  dissemination 
effort.    The  TRCs  were  organized  by  OBE,  while  the  PIP  development  was 
directed  independently  by  OPBE.    Coordinated  planning  by  OBE  and  OPBE  for 
the  dissemination  of  the  PIPs  by  the  TRCs  was  carried  out  in  September  and 
October  1976.    The  formal  "training"  of  the  disseminators  was  a  one'-day 
orientation  workshop  conducted  by  OPBE  and  OBE  and  attended  by  one  repre- 
sentative from  eac^  TRC  plus  many  of  the  OBE  program  staff*    The  workshop 
was  held  on  November  3,  1976  and  covered  the  content  and  format  of  the  PIP 
materials  as  well  ^--^  the  intended  dissemination  process.    Given  the  brevity 
of  the  workshop,  only  general  briefings  were  possible.    For  example,  two 
hours  were  scheduled  for  review  of  the  PIPs  and  related  awareness  booklets. 
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a  set  of  materials  comprising  on  the  order  of  3^000  pages.  Additional 
familiarization  wss  left  to  the  IRC  personnel  tht>mselves. 

The  outcome  of  these  processes  was  that,  by  and  large,  the  TRC  per-- 
sonnel  had  a  good  understanding  of  the  structure  of  the  pip  mterials  and 
of  the  dissemination  processes  they  were  supposed  to  follow  (see  selection/ 
adoption,  below).    They  received  little  training  on  the  features  of  the 
projects,  however*  and  they  had  little  incentive  or  time  to  analyze  the 
projects  in  depth  on  their  own*    Subsequent  indications  were  that  they  had 
a  rather  superficial  understanding  of  the  projects  and  of  the  differences 
among  the  projects. 

Attitudes  of  TRC  personnel  differed  widely.    Many  were  skeptical  of 
the  Pips  as  an  approach  to  diffusing  projects.    Some  felt  that  the  projects 
described  in  the  PIPs  were  not  the  best  ones  available.    In  all  cases, 
the  dissemination  activities  imposed  sn  unexpected  task  on  the  TRCs,  half 
of  which  were  just  getting  started,  and  no  extra  funds  or  staff  were  pro*< 
vided  by  USOE.    Some  reacted  negatively  to  this  extrs  vork  load. 

7.3.3.2  Other  resources;    funds  and  materials.    As  indicated  above, 
no  special  funds  or  other  resources  were  provided  to  the  TRCs  for  their 
PIP  dissemination  activities.    A  brief,  disseminator's  guide  developed  for 
the  compensatory-education  PIPs  was  adapted  for  the  use  of  TRC  personnel. 
In  principle,  one  might  expect  such  materials  to  be  quite  helpful  in  guid-^ 
ing  the  TRC  use  of  the  various  PIP  awareness  and  LEA  training  materials. 
However,  the  disseminator's  manuals  for  both  bilingual  and  compensatory* 
education  PIPs  were  largely  unused  and,  based  on  this  result,  ve  doubt 
that  such  a  manual  could  have  had  much  impact  on  PIP  dissemination  unless 
the  manual  were  incorporated  into  some  form  of  Intensive  training  workshop 
for  the  TRC  diffusion  personnel. 

7.3.3.3  Plana  and  constraints  (the  USOE-developed  diffusion  plan). 
The  diffusion  plan,  summarized  under  selection/adoption  (7*3.4),  was 
deviiloped  by  USOE  and  presented  to  the  TRCs  in  the  November  1976  brief*< 
ing.    The  plsn  was  apparently  clear  to  the  TRCs  but,  in  the  terma  of  the 
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diffusion  model*  the  ^'iinage^*  of  the  plan  was  that  of  a  set  of  regulations 
imposed  from  above.    From  discussions  with  TRC  personnel*  we  conclude  that 
this  negative  image  contributed  to  the  lack  of  enthusiasm  on  the  part  of 
some  TRCs. 

7.3.4    Preparation  of  Tairget  LEA  Components 

7.3.4.1  Personnel  (capacity  building).    Under  the  conventions  of 
ttle  bilinguaI-*PIP-*d  if  fusion  model*  preparation  of  LEA  personnel  for  dif-* 
fusion  could  include  both  skill  building  and  developing  readiness  for 
change.    Neither  kind  of  activity  was  included  in  this  experimental  effort* 
and  the  outcome  was  that  many  target  LEAs  were  neither  ready  to  adopt  the 
PIP  projects  nor  capable  of  providing  personnel  with  the  required  skills 
(e.g.*  bilingual  teachers). 

7.3.4.2  Other  resources  (development  of  the  PIPs).    PIP  development 
was  by  far  the  dominant  activity  in  che  preparation  stage.    Following  nor-* 
mal  USOE  procedures*  packaging  was  done  by  an  outside  firm  (CEMREL  Inc.) 
under  contract  to  OPBE.    In  the  terminology  of  the  diffusion  mcdel*  pack^ 
aging  skills  were  "selected"  rather  than  "trained"  (see  Seruion  5.2.2.2). 
That  is*  it  was  implicitly  assumed  that  the  packaging  contractors  could 
produce  appropriate  materials  with  no  more  training  th^n  a  brief  period 

of  orientation  to  the  PIP  studies  already  completed  or  in  progress.  Of 
course*  as  noted  under  initial  conditions*  the  entice  effort  was  explora.* 
tory*  as  very  little  information  existed  on  how  to  package  exemplary 
projects.    The  results  of  the  SRl/RMC  PIP  field  test  and  revision  study 
(Studies  2  and  3)  were  made  available  to  CEMREL  as  the  study  progressed 
and*  ultimately!  the  revised*  compensatory.*education  PIPs  were  used  as 
models  for  the  bilingual-PIP  format  and  content. 

The  packaging  of  the  four  bilingual-PIP  projects  was  carried  out 
during  the  1975**1976  school  year*  tb3  same  year  that  RMC  was  rewriting 
the  original  six  compensatory-education  PIPs.    Although  CEHREL  was  thor*- 
oughly  experienced  in  a  variety  of  packaging  techniques*  they  had  not 
been  previously  involved  in  searchin^^  for  exemplary  projects*  in  bilingual 
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education^  nor  in  the  analyaia  of  projects  for  PIP-type  (comprehensive^ 
hoW"tO"do*it}  packaging*    With  only  one  year  and  a  limited  budget  within 
which  to  package  four  bilingual  projects  as  well  aa  aearch  for  and  package 
up  to  eight  compenaatory  projecta*  USOE  decided  that  the  design  of  the 
revised^  compenaatory^education  PlPa  should  be  adopted  for  all  of  the  bi^ 
lingual  PlPa*    In  the  fall  of  1975,  CEMREL  viaited  each  project  for 
aeveral  davs  to  identify  project  features*    Then,  in  the  spring  of  1976, 
as  the  RMC  manuala  were  completed,  CEMREL  received  early  copies  and  pre^ 
pared  manuals  for  the  bilingual  projects  following  the  general  format  of 
the  RMC  pIPs* 

The  outcome  of  the  PIP  development  effort  was  a  set  of  four  PIPs^-SO 
copies  of  each*    According  to  the  develope^'^aite  personnel,  the  descrip** 
tions  of  their  projects  were  fairly  accurate  in  most  respects*  However, 
due  to  the  nature  of  the  projects,  the  descriptions  were  at  the  lev^l  of 
general  guidelines  rather  than  specific  inatructional  and  management  tech** 
niquea*    This  reflects  the  fact  that  the  developer  sites  themselves  ap- 
parently operated  largely  on  the  basis  of  general  guidelinea  interpreted 
by  skilled  and  enthuaiastic  staff  (see  Question  1  in  Figure  8)* 

The  bilingual  PIPs  were,  in  appearance,  much  like  the  reviaed, 
compenaatory-education  PIPs*    In  fact,  of  course,  there  waa  a  major  dif- 
ference in  the  amount  of  development  effort  represented  by  the  two  aeta 
of  packages*    The  reviaed,  compensatory-education  PIPs  incorporated  the 
experience  of  three  years  of  development,  extencive  field  testing,  and 
revision*    The  field  testing  brought  in  the  insighta  of  nineteen  project 
direcors  and  many  expert  teachers  and  administrators,  and  the  revision 
effort  allowed  BMC  staff  to  revisit  the  developer  sites  for  additional 
information  after  a  full  year  of  watching  adoptera  atruggle  with  a  variety 
of  problems*    Having  observed  the  problems  faced  by  adopters,  RMC  was  able 
to  focua  on  the  exact  methods  used  by  the  developers  to  solve  these  prob- 
lema  and  to  emphasize  these  solutions  in  the  revised  PIPs*    By  contrast, 
CEMREL  was  able  to  make  only  one  or  two  brief  visita  to  basically  unfamil" 
iar  types  of  projects*    The  bilingual  PIPs  uere  limited  to  the  information 
gained  on  these  visita  plus  a  limited  amount  of  additional  input  from  the 


developer-site  project  directors.    Further^  the  format  for  the  PIPs  was 
not  available  until  well  after  data  collection  had  ended  and  some  sections 
had  to  be  written  without  complete  Information  from  the  developer  sites. 
Thus,  while  the  bilingual  PIPs  reflected  the  appearance  of  the  revised  BMC 
PIPs,  the  stage  of  development  was  more  analogous  to  the  first  RMC  proto** 
type  PIPs. 

The  problems  with  the  bilingual  PIPs  were  of  several  types.    In  general^ 
they  were  designed  for  an  unspecified  audience  without  adequate  provision 
for  the  different  levels  of  experience  and  resources  among  the  target  LEAs. 
They  lacked  specific  Instructional  guidelines,  and  there  were  many  specific 
problems  characteristic  of  prototype  materials.    One  of  the  purposes  of 
the  field-test  was,  of  course,  to  Identify  and  correct  such  problems.  How- 
ever, while  we  were  sensitive  to  these  problems,  In  BMC's  judgment  the  real 
problems  with  the  diffusion  system  were  much  more  fundamental,  and  could 
not  be  resolved  by  revising  the  PIPs.    We  are  convinced  that  a  successful 
diffusion  effort  Is  unlikely  unless  all  elements  of  the  diffusion  effort 
are  addressed  systematically,  as  discussed  throughout  this  report. 

7.3.4.3    Plans  and  constraints  (selection  of  the  projects).    The  se- 
lection of  the  projects  for  packaging  did,  of  course,  precede  the  devel- 
opment of  the  PIPs.    Under  the  conventions  of  the  PIP-dlf fusion-system 
model,  however,  the  projects  are  treated  as  plans  to  be  used  by  the  target 
LEAs  to  establish  bilingual  progra'na,  and  thus  the  selection  process  Is 
described  here  under  the  heading  of  LEA  plans  and  constraints. 

The  AIR  search  for  exemplary  bilingual  projects  began  In  mld-1974. 
The  search  Is  described  In  detail  In  Campeau  et  al  (1975)*    Briefly,  AIR 
and  USOE  established  project  selection  criteria  that  were  systematically 
applied  to  every  candidate  for  exemplary  status  that  AIR  could  locate. 
Among  the  criteria  was  "evidence  of  statistically  and  educationally  slg*^ 
nlflcanc  Impacts  on  student  achievement,"  the  criterion  to  be  reviewed 
by  the  JDRP  as  a  condition  for  USOE-sponsored  dissemination.    Given  the 
limited  amount  of  Impact  that  can  reasonably  be  expected  from  Improvements 
In  school  Instruction,  and  given  also  the  lack  of  methodology  for  precise 
evaluation  of  such  projects  (Horst,  1977)  this  criterion  constituted  a 
severe  limitation  on  the  number  of  exemplary  projects  that  could  be  found. 
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AIR  eventually  submitted  seven  projec    evaluations  to  the  JDRP»  and  four 
were  approved  as  convincing*    It  was  these  four  projects  that  were  subse* 
quently  packaged  by  CEMREL* 

Two  points  should  be  emphasized*    First»  although  many  other  criteria 
were  used  by  AIR»  and  the  leading  candidate  projects  were  site-vlslted  to 
confirm  the  existence  of  their  program  features*  the  availability  of  con** 
vincing  achievement  data  played  a  decisive  role  in  the  selection  of  the 
bilingual  projects*    Second*  both  the  project  features  and  the  evaluations 
reflected  the  state*of*the*art  prior  to  1974*    Both  of  these  factors  have 
proven  to  be  Important  In  the  1977-1979  field  test  of  bilingual  PIP  proj- 
ects* since  neither  the  project  features  nor  the  evaluation  methodology 
were  entirely  suitable  for  diffusion* 

Selection  outcomes*    The  outcome  of  selection  was  the  set  of  four 
prol^cts*    All  of  the  projects  were  intended  for  grades  K  through  four* 
all  had  similar  staffing  patterns*  all  specified  starting  with  the  first 
two  grades  and  expanding  upward  one  year  at  a  time*  and  all  were  for 
similar  student  populations*    None  dealt  with  small  groups  of  non-English 
speaking  students  or  with  mixes  of  non-English  languages*  Subsequently* 
these  project  features  played  a  major  role  in  determining  the  market  for 
the  PIPs* 

When  comparing  the  features  described  in  the  four  PIPs  with  each 
other*  most  differences  appeared  to  be  minor  and  unrelated  to  either  the 
effectiveness  of  the  projects  or  the  contexts  in  which  they  were  designed 
to  operate  (see  Appendix  C  for  a  detailed  analysis)*    Among  the  more  appar- 
ent differences  were  minor  variations  in  staffing  patterns  (e*g**  use 
of  curriculum  coord  nators  and  other  support  staff)  and  the  use  of  team 
teaching  In  one  project*    In  both  cases*  the  differences  appeared  to  be 
artifacts  of  local  conditions  and  policies  rather  than  carefully  planned* 
unique  features  of  the  bilingual  programs* 

The  lack  of  uniqueness  was  a  factor  of  particular  concern*  Although 
the  projects  as  described  in  the  PIPs  were  not  compared  systematically 
with  bilingual  projects  in  the  entire  pool  of  potential  adopters*  there 
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Is  nothing  to  suggest  that  major  qualitative  differences  would  be  found. 
There  were  undoubtedly  large  differences  In  how  well  other  districts  were 
Implementing  their  programs^  but  at  the  level  of  description  provided  In 
the  PIPs»  many  districts  could  claim  to  have  the  same  features  as  the  four 
exemplary  projects.    The  19  fleid*test  sites  reported  that  they  saw  little 
that  was  dramatically  Innovative  In  the  projects  and»  therefore^  did  not 
hesitate  to  try  to  improve  upon  the  projects. 

In  the  Introduction  to  this  report^  project  factors  favorable  to 
successful  diffusion  are  contrasted  with  factors  unfavorable  to  diffu- 
sion (Section  2.2.2.2).    The  four  blllngual^PIP  projects  typify  all  six 
of  the  unfavorable  factors; 

•  Management  rather  than  Instructional  focus  In  the  project. 

•  Whole-school^  vhole-day  projects. 

•  General »  flexible  guidelines  for  operation. 

•  Dynamic^  evolving  practices. 

•  Requirements  for  exceptionally  skilled  staff. 

•  Conventional  Ideas  applied  unusually  well. 

To  elaborate^  many  of  the  features  that  distinguished  the  original^ 
exemplary  projects  Involved  project  management.    These  features  Included 
staff  organization  and  roles^  project  director's  management  style^  staff 
selection  and  hiring  guidelines^  staff  development^  and  relations  with 
district  administrators  and  non-'project  staff.    While  these  are  major 
factors  distinguishing  good  programs  from  poor  ones^  such  management  fea- 
tures are  not  readily  transportable^  since  they  usually  require  changes 
to  firmly  established^  LEA  organizational  and  administrative  structures. 

The  fact  that  the  bilingual  projects  were  wholes-school »  whole-day 
projects  was  also  a  negative  factor  from  the  perspective  of  a  diffusion 
planner.    While  relatively  autonomous^  encapsulated  projects  (like  the 
compensatory-'education  reading  and  nath  labs)  can  usually  be  Implemented 
by  volunteer  personnel  with  very  little  change  to  the  school  as  a  whole^ 
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the  bilingual  projects  required  a  wide  variety  of  changes  on  the  parts  of 
administratorsi  teachers^  and  students^  many  of  whom  had  no  desire  to  make 
the  changes . 

The  instructional  festures  of  the  projects  were  generally  flexible  in 
the  developer  sires.    That  iS|  the  prolects  consisted  basically  of  a  well 
managed  context  in  which  each  teacher  could  apply  her  or  his  professional 
skills.    Such  projects  typically  provide  the  teachers  with  (a)  consulting 
support  from  the  project  director  and  other  project  consultants*  (j)  sup- 
port from  the  other  project  teachers  via  regular  staff  meetings  and  work* 
shopsi  (c)  staff  development  via  scheduled  inservice  and  university  credit 
progrfimsi  and  (d)  adequate  instructional  materials.    In  general*  the 
teachers  work  within  the  constraints  of  the  established  local  curriculum. 
When  such  a  p3£*ojet!t  is  adopted  in  a  different  district  with  a  different 
organization,  curriculum,  and  staffs  substantial  adaptation  is  usually 
required  and,  in  any  esse,  the  instruction  reci^iVed  by  the  students  may 
have  little  or  no  relation  to  that  received  in  tne  developer  site. 

Such  projects  contrast  sharply  with  projects  based  on  highly  struc- 
tured, instructional  approaches  (e.g.,  programmed  instruction  or  programmed 
teaching)  in  which  adopters-site  students  experience  much  the  same  instruct 
tion  as  did  the  developer-^site  students.    Furthermore,  the  flexible  in- 
structional guidelines  of  the  management-centered  projects  were  of  only 
limited  help  to  either  the  experienced  or  the  inexperienced  adopter  sites* 
both  of  which  were  usually  more  interested  in  new  instructional  approaches 
than  in  management  strategies. 

The  exemplary  bilingual  projects  were  in  a  state  of  dynamic  evolution 
at  the  time  that  they  were  packaged.    Thus,  the  projects,  as  packaged, 
were  several  years  old  by  the  time  they  reached  adopters.    Materials,  and 
in  some  cases  methods,  were  often  Viewed  by  adopters  as  out  of  date. 
The  materials  were  a  particular  problem  from  a  PIP-dif fusion  perspective, 
because  adopter^-sitb  teachers  often  build  their  instruction  around  the 
available  instructional  materials,  especially  in  the  early  stages  of  a 
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nev  program*    Thus,  they  are  most  interested  in  the  materials  used  by  the 
exemplary  sites*     In  the  case  of  the  exemplary  bilingual  projects,  the 
developer  sites  selected  the  best  th^  could  find  among  currently  avail-^ 
able  materials  to  supplement  locally^mandated  core  texts^    While  the  PXPs 
listed  those  materials,  many  vere  out  of  print  or  considered  obsolete  by 
the  time  th'^  PXPs  vere  available  and,  in  any  case,  each  adopting  district 
had  its  own  state  or  locally  mandated  texts*    In  the  meantime,  the  devel** 
oper  sites  had  been  free  to  replace  the  materials  listed  in  the  PXPs  vith 
newer  editions  or  more  attractive  alternatives* 

All  four  projects  depended  heavily  on  good  bilingual  teachers*  This 
drastically  reduced  the  number  of  potential  adopters  for  which  the  proj-^ 
ects  were  suitable,  since  an  adequate  supply  of  good  bilingual  teachers 
is  not  readily  available  in  many  LEAs*    The  lack  of  such  teachers  did  not 
keep  sites  that  lacked  them  from  applying  for  PXPs,  and  some  adapted  admir** 
ably,  using  team  teaching  or  bilingual  aides  to  provide  the  required  Ian** 
guage  skills*    However,  the  need  for  this  kind  of  adaptation  reflected 
the  fact  that  the  projects,  as  packaged,  did  not  meet  the  needs  of  theae 
target  LEAs* 

As  noted  above,  the  projects  were  relatively  minor  variations  on 
standard  themes*    Thus,  while  experienced  sites  may  have  found  some  good 
ideas,  they  should  not  have  expected  any  major  innovations*    Sites  with 
no  bilingual**education  experience  could  appropriately  have  expected  basic-^ 
ally  sound  advice,  although  comparable  advice  was  available  from  a  multi- 
tude of  other  sources*    From  a  diffusion  perspective,  this  meant  that  ex^ 
perienced  sites  found  relatively  little  to  adopt*    The  inexperienced  sites 
found  much  to  adopt  but,  given  the  many  other  sources  of  the  information 
(TRCs,  consultants,  publications,  other  LEAs,  universities,  and  so  on), 
it  did  not  appear  that  the  PXPs  represented  a  cos t *-ef feet ive  addition  to 
the  pool  of  information  sources* 

7*3*4*4    Student a*    There  were  no  major  activities  involving  students 
during  the  preparation  stage,  either  Intended  or  actual* 
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7-3.5    Summjarv  of  Progress  and  Problems;  Preparation 


This  section  sunmtsrlzes  the  major  problems  encountered  during  the 
preparation  stage.    This  stage  began  with  the  AIR  contract  to  select  ex-^ 
emplary  bilingual  projects^  and  continued  through  the  briefing  In  which 
USOE  explained  the  diffusion  task  to  the  TRCs. 

7.3.5.1  USOE.    At  the  beginning  of  the  preparation  stage^  USOE  per*- 
sonnel  (a)  had  a  general  goal  of  diffusing  exemplary  projects »  (b)  were 
In  the  process  of  developing  the  PIP  concepts,  and  (c)  had  established  an 
approach  to  Identifying  exemplary  projects.    Preparation  consisted  basic 
ally  of  Identifying  exemplary  projects  according  to  established  procedures 
and  packaging  them  In  the  PIP  format,  that  Is,  of  combining  two  available 
and  complementary  approaches.    In  retrospect.  What  was  needed  was  to 
analyze  the  needs  of  target  LEAs  and  the  projects  (or  practices)  available 
to  meet  those  needs*  and  then  to  design  a  <iellvery  system  for  bringing  the 
practices  and  LEAs  together.    The  result  In  the  field  test  of  the  two  com-* 
blned  approaches  (l*e.,  projiact  selection  and  PIP  packaging)  was  that  the 
projects  were  not  well  suited  to  target  LEA  needs  and  the  delivery  system 
was  not  well  suited  to  the  project-LEA  combinations. 

7.3.5.2  Dlff users.    The  TRCs  were  an  existing  diffusion  and  techni- 
cal assistance  system  that  was  an  obvious  component  for  the  experimental 
PIP  delivery  system.    There  were  three  problems*  however.  In  the  way  In 
which  the  TRCs  were  used.    First,  they  were  given  a  diffusion  plan  that 
they  had  had  no  part  in  developing.    Second,  they  were  given  only  minimal 
orientation  to  the  plan,  and  third,  they  were  not  given  additional  resources 
to  support  their  PIP-dlff uslon  activities.    The  results  were  that  the  TRCs 
did  not  have  the  skills  and  knowledge  required  for  their  roles,  nor  did 
they  have  the  positive  attitudes  toward  the  PIP  diffusion  approach, 

7.3.5.3  Target  LEAs.    llie  target  LEAs  varied  widely  In  terms  of 
decision-maker  attitudes  and  potentlal~project-*staf f  skills  and  attitudes. 
In  principle,  the  diffusion  system  could  have  accommodated  these  differ- 
ences either  by  providing  for  capacity  building  In  sites  that  could  benefit 
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from  such  efforts  or  by  tailoring  the  diffusion  system  to  a  limited  group 
of  appropriate  target  LEAs*    Instead,  the  pool  of  target  LEAs  was  treated 
as  relatively  homogeneous,  with  the  result  that  diffusion  system  was  in^ 
appropriate  to  many  of  the  target  LEAs  (including  several  of  the  fields 
test  sites}* 

As  noted  under  USOE,  above,  the  PIPs  and  ^he  projects  (which  fall 
under  the  LEA  heading)  were  not  appropriate  to  the  needs  and  resources 
of  the  LEAs* 

In  short,  the  Plp^diiff usion  system  was  the  result  of  an  experimental 
attempt  to  meet  USOE  diffusion  goals  by  combining  an  existing  project* 
selection  procedure,  an  existing  packaging  approach  and  an  existing  dif- 
fusion organization  (the  TRCs)*    With  the  advantage  of  hindsight,  it  is 
clear  to  us  that  this  combination  coula  not  have  met  the  USOE  goals*  In 
the  terms  of  the  PlP^dif fusion-system  model,  the  major  system  breakdowns 
had  occurred  by  the  end  of  the  preparation  stage* 
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7.4    Stage  2;    Select Ion /Adopt Ion 


7*4.1  Overview 

7.4.1.1    Definition  of  Stage  2.    The  selection/adoption  stage  begins 
with  the  first  contact  between  the  TRC  diffusion  personnel  and  Che  poten- 
tial adopter  sites.    It  continues  through  the  commitment  to  adopt  a  spe- 
cific project  as  Indicated  by  the  snbmlss*:>n  of  a  Title  VII  grant  appli- 
cation. 

7*4*1*2    Major  features  and  problem  areas.    The  dissemination  plan> 
an  presented  to  TRC  representatives  by  USCZ  at  the  ttovember  3  workshop» 
was  as  follows:    Each  TrX  was  to  Identiry  potential  adopters  through  SEA 
records*  QBE  lists  of  previously  unsuccessful  Title  VII  applicants*  per- 
sonal knowledge*  and  any  other  av?llable  sources  of  information.  Poten- 
t-^.al  adopters  were  to  be  mailed  an  ASK*  the,'  telephoned  at  about  the  time 
the  ASK  arrived  to  explain  the  purpose  of  the  ASK  and  the  dissemination 
effort*    A  second  phone  call  was  to  be  scheduled  about  a  week  later  to 
answer  questions  and  determine  the  level  of  Interest.    A  third  call  or  a 
visit  was  to  be  made  to  interested  districts  for  the  purpose  of  lnif:lating 
technical  assistance  in  the  preparation  of  grant  applications.  Project 
Orientation  and  Planning  Materials  were  also  to  be  sc  t  to  interested 
alstricts.    Addltlnnal  technical  assistance  was  lo  be  provided  by  iRCs  in 
special  PIP  workshops  or  by  expanding  previously  scheduled  workshops  to 
include  PIPs.    A  log  of  ASK  mailings*  listing  dates  and  LEA  names*  was  due 
at  QBE  by  30  November.    Title  VII  grant  applications  from  candidate  LEAs 
were  to  be  due  on  20  January. 

Ncminally*  the  dissemlr  ation  effort  proceeded  much  as  planned*  but 
there  were  three  slgnifican    areas  of  departure;    fir^t*  the  variation 
in  commitment  and  levels  of  effort  among  the  TRCs;  second*  the  slippage 
in  the  dlsseminatlo;i  time  schedule;  and  third*  the  intervention  in  the 
dissemination  process  by  non-TRC  (i*^**  USOE  and  SEA)  personnel.  The 
attitudes  of  the  TRC  personnel  are  discussed  unde*:  Preparation  of  Dif- 
fusers  (7.3.3)c    Otherwise,  these  issues  are  discussed  under  Selection/ 
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Adoption  Activities   effecting  Target  LEAs  (7.4.4).    Other  key  selection/ 
adoption  problems  and  IQsues  are  Indicated  In  Figure  11. 

It  should  be  noted  that  selectl.  a/adoptlon  occurred  during  ch^  winter 
of  1976-1977,  while  the  KMC  study  began  In  late  July  of  1977.    Thu&,  all 
activities  described  in  this  section  have  been  reconstructed  from  fl^es 
and  Interviews  obtained  by  KMC  a  year  or  more  after  the  events.  However, 
although  some  Information  was  undoubtedly  lost  due  to  the  delay,  we  believe 
that  omissions  o**  Inaccuracies,  If  any^  are  not  of  sufficient  importance 
to  affi^ct  the  conclusions  of  the  study. 

7.4.2    Selection/Adoption  Activities  Affecting  USOE 

7.4.2.1  USOE  personnel  _Cfeedback  on  selection/adoption  progress). 
While  there  was  no  formal  "intended"  model  for  activities  affectini?^  USOE 
during  selection/adoption,  it  is  implicit  in  the  experimental  nature  of 
the  field  test  that  USOE  personnel  should  be  provided  with  feedback  that 
uould  permit  them  to  adjust  USOE  and  diffuser  plans  where  necessary  to 
meet  the  study  objectives.    In  fact,  such  feedback  was  obtained  and  uaed, 
as  described  belev. 

The  main  sources  of  feedback  on  the  selection/adoption  process  were 
the  TEC  logs  of  LEA  contacts,  the  direct  communications  with  TEC  personnel, 
and  the  LEA  Title  Vll  grant:  applications.    From  these  three  sources,  USOE 
personnel  were  aware  of  the  progress  of  the  selection/adoption  activities 
and,  in  particular,  tmd^rstood  (a)  that  TRC  dlsaeminatlon  schedules  were 
slipping,  (b)  that  very  few  LEAs  were  responding  positively  to  the  aware- 
ness activities,  and  (c)  that  subsequently  (after  additional  LEA  applicants 
had  been  recruited),  some  of  the  PIP  projects  were  selected  by  fewer  than 
four  LEAs,  the  minimum  number  desired  by  USOE  for  purposes  of  the  study. 

7.4.2.2  Other  resources!    TRC  logs  and  Title  VII  grant  applications. 
The  major  materials  used  by  USOE  in  selection/a^  jption  were  the  TEC  logs 
and  the  Title  VII  grant  applications.    The  TEC  logs  provided  the  infonna- 
tion  that  they  were  intended  to  provide.    The  Title  VII  grant  applications 
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 Stage  2:    Selection/Adoption  (7*4) 

USOE  (7*4*2) 

Personnel  (7*4*2*1) 

•  Feedback  on  selection/adoption  progress 

Other  resources  (7*4*2*2) 

•  TRC  logs  and  Title  VII  grant  applications 

Plans  and  constraints  (7*4*2*3) 

•  Revised  timetables  and  USOE  participation 


Dlffiisers  (7*4.3) 

Personnel  (7*4*3*1) 
Other  resources  (7*4*3*2) 
Plans  and  constraints  (7*4-3^3) 


Target  LEAs  (7*4*4) 

Personnel  (7*4*4*1) 

•  Initial  screening  of  LEAs 

•  Informing  versus  convincing  the  LEAs 

•  TRC  priorities  and  time  schedules 

•  USOE  and  SEA  dissemination  activities 
«  LEA  motivation  to  adopt  via  PIPs 

•  Grant  applications^  and  USOE  selection  of  fields-test  sites 

•  Outcomes  of  dissemination  and  selt=ctlon  processes 

Other  rea; Mr^^s  (7*4*4*2) 

•  The  PIP  Image 

Plans  and  ccastralnts  (7*4*4*3) 

•  Project  selection 

Students  (7*4*4*4) 

•  Student  selection 


Figure  11*    Actual  PIP  diffusion  .system;  Sta^^A  2  key  Issues* 
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were,  Ir,  RMC's  Judgment,  Inadequate  for  the  needs  of  a  satisfactory  selec- 
tion/adoption process.    Although,  given  the  many  other  problems  affecting 
the  blllngual-PIP  diffusion  system,  it  Is  unlikely  that  Improvements  In 
:he  application  forms  would  have  had  any  noticeable  effect  on  the  diffusion- 
systeii  outcomes,  nevertheless  these  forms  were  the  key  components  In  USOE's 
LEA"selection  process.    The  forms  were  clearly  not  designed  with  the  Idea 
of  channeling  appropriate^  exemplary  projects  or  practices  to  target  LEAs, 
and  the  entlrr  t^^^pllcatlon  process  would  need  to  be  reconsidered  In  any 
systematic  approach  to  planning  a  diffusion  system. 

7.4.2.3    Plans  and  constraints  (revised  timetables  and  USQE  partic- 
ipation)*   Based  on  the  available  Information,  the  plans  for  USOE  non-- 
participation  In  selection/adoption  were  changed,  and  USOE  began  to  take 
an  active  role  in  recruiting  applicants  and  In  the  project-selection  pro- 
cess.     USOC  participation  became  a  major  (perhaps  dominant)  factor  In 
the  actual  selection /adoption  process  as  described  Tinder  the  LEA  section 
(7.4.4),  below.    In  addition,  the  time  schedule  was  adjusted  to  provide 
the  time  needed  for  recruiting  additional  field-test  sites. 

7.4.3    Selection/Adoption  Activities  Affecting  Dlffusers 

7.4.3.1  Diffusion  personnel.    The  diffusion  plans  did  not  call  for 
any  further  training  of  diffusion  personnel  d'lrltig  selection/adaption, 
and  no  formal  training  c':curred.    Of  course,  the  TRCs  received  feedback 
from  their  dissemination  activities,  and  kr,^>;  that  there  was  Very  little 
response  from  the  target  LEAs  but,  in  general,  they  did  not  act  on  this 
information. 

7.4.3.2  Oth<ir  resources.    No  major  development  of  materials  for 
TRCs  or  changes  In  TRC  facilities  or  funds  were  intended  during  the  selec- 
tion/adoption stage^  and  none  occurred. 

7-4.3.3    Plans  and  constraints.     In  general,  no  major  changes  In 
diffusion  plans  were  made  during  spjectl  n/adoption*    One  notable  excep- 
tion occurred  when  an  SEA  arranged  for  one  SEA  disseminator  together  with 
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one  TRC  staff  member  to  visit  all  target  j^EAs  in  the  state*  According 

to  the  TRC  staff  meiDber»  one  adoption  could  be  attributed  to  these  visits* 

7*4*4    Selection/Adoption  Activities  Affecting  Target  lEAb 

7*4*4*1    LEA  personnel*    The  basic  objective  of  the  intended  selec- 
tion/adoption dissemination  activities  was  to  obtain  applications  from 
target  LEAs  for  appropriate  PIPs*    The  basic  approach  was  to  provide 
information  to  LEA  decision  makers  that  would  motivate  them  to  apply* 
Thus,  most  of  the  selection/adoption  activities  fall  under  the  general 
heading  of  informing  and  motivating  LEA  personnel*    In  describing  the 
results,  we  distinguish  between  two  sequential  choices-*-^f irst,  the  choice 
to  adopt  via  a  PIP  and  second,  the  choice  among  the  four  PIPs*    A  third 
process,  selection  of  PIP  recipients  from  among  the  applicants,  was  part 
of  the  intended  PIP  diffusion  model  bat,  due  to  the  limited  number  of 
app] ications,  all  applicants  that  qualified  for  Title  VII  grants  (all 
but  one  of  Lha  PIP  applicants)  were  ir  luded  in  the  PIP  study* 

Initial  screening  of  LEAs*    The  methods  of  screening  lEAs  for  initial 
contact  varied  substantially  among  TRCs*    Some  TRC  disseminators  screened  * 
out  ISAb  that  had  small  numbers  of  potentially  eligible  students;  others 
contacted  all  LEAs  in  their  service  area  who  did  not  have  Title  VII  pro- 
grams; others  contacted  only  those  LEAs  with  an  expressed  interest  in 
applying  for  a  Title  VII  grant,  or  those  that  had  previously  submitted 
unsacc<^s3lal  Title  VII  applications* 

Informing  versus  convincing  the  LEAs*  The  Variations  in  TRC  enthu- 
siasm appeared  to  be  a  key  factor  in  the  relative  numbers  of  adopters 
recruited  by  the  different  TRCs*  Under  the  nominal  pystetr,  the  major 
diffusion  activity  was  the  disset ination  of  information*  That  is,  LEAs 
were  to  be  infor!ned  about  the  PIPs  through  the  ASKs  anJ  the  TRC  phone 
calls*  Based  on  this  information,  LEAs  would  then  adopt  PIP  projects 
that  r^t  their  needs  based  on  their  analysis  of  the  information* 
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In  fact,  dissemination  of  information  proved  to  be  only  one  part  of 
an  effective  diffusion  strategy.  Most  LEA  decision  makers  are  '  .uged  with 
such  information  from  a  multitude  of  sources  and  can  process  only  a  limited 
amount  of  it  in  any  detail.  To  ensure  that  the  appropriate  decision  makers 
in  an  LEA  gave  serious  consideration  to  PIP  adoption  appeared  to  req'tire  an 
enthusiastic  sales  job  by  someone  with  substaiicial  credibility. 

The  result  in  the  bilingual-?IP  dissemination  wa;^  that,  while  all  TRCb 
met  their  obligations  to  disseminate  ASKs  to  potential  adopters,  only  those' 
that  followed  up  very  aggressively  obtained  more  than  an  occassional  ex* 
pression  of  serious  interest.    Only  seven  or  eight  of  the  fifteen  TRCs 
were  associated  with  actual  adoptions  and,  in  some  of  these  cases,  factors 
other  than  the  TRC  efforts  were  largely  responsible  for  the  adoptions. 

TRC'priorities  and  time  schedules.    The  PIP  dissemination  activities 
had  to  be  accommodated  in  TRC  schedules  that  were  already  full,  and  at 
least  some  of  the  TRC  (directors  felt  that  their  previously  planned  activi* 
ties  had  greater  potential  foi:  positive  impact  and  required  equal  or  higher 
priorities.    While  some  of  the  TRC  logs  showed  extensive  mailings  by  mid- 
November,  much  of  the  mailing  was  done  in  December  and  some  was  carried 
on  into  January.    The  deadline  for  grant  applications  was  extended  accord- 
ingly until  the  end  of  February. 

USOE  and  SEA  dissemination  activities.    Anoth-.r  departure  from  the 
nominal  dissemination  plans  involved  the  direct  intervention  of  USOE  and 
SEA  personnel.    This  form  of  dissemination  was  generally  not  documented, 
but  was  mentioned  so  frequently  by  LEA  and  TRC  personnel  that  it  appears 
to  have  been  a  major  factor  in  convincing  the  19  PIP  field-test  sites  to 
adopt.    In  the  relevant  cases,  the  personal  encouragement  of  senior  USOE  or 
SEA  personnel  apparently  provided  the  incentive  to  consider  a  PIP  adoption 
seriously. 

One  SEA,  'which  was  actively  attempting  to  increase  the  number  of 
Title  vlt  programs  in  the  state,  convened  a  Title  VXI  proposal-writing 
conference  in  cooperation  with  a  TRC.    All  interested  LEAs  in  the  state 
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were  Invited^  and  the  PIPs  were  introduced  at  this  meeting.    LEAs  that 
expressed  Interest  were  called  back  to  another  meeting  at  which  an  outside 
educational  development  contractor  had  been  Invited  to  participate.  This 
contractor  voluntefered  to  write  the  Title  VII  proposals  for  LEAs  with  the 
expectation  that>  If  funded^  the  LEAs  would  contract  their  staff  develop- 
ment and  project  evaluation  components  to  the  contractor*    Four  of.  the  six 
LEAs  that  applied  for  PIPs  from  this  state  accepted  this  arrangement.  In 
totals  the  SEA-TRC^LEA  Interaction  In  this  state  contributed  to  six  of  the 
19  PIP  adoptions. 

LEA  motivation  to  adopt  via  PIPs.    The  LEA  motivations  to  adopt  were 
complex  andf  of  course^  Involved  more  than  the  encouragement  from  USOE^ 
SEA»  or  TRC  advocates.    All  sltes^  for  one  reason  or  another^  wanted  a 
bilingual  program.    At  least  eleven  of  the  sites  had  existing  Title  VII  or 
state  programs  that  they  wished  to  upgrade  or  expand.    Virtually  all  sites 
saw  the  PIP  adoption  a&  increasing  their  chances  for  Title  VII  fundings 
either  because  they  felt  the  PIPs  would  help  in  the  preparation  of  higher 
quality  grant  applications  or  because  they  believed  that  some  preference 
would  be  shown  to  PIP  adopters  (although  QBE  guidelines  stated  explicitly 
that  all  applications  would  be  Judged  solely  on  their  merits »  and  no 
me:itlon  of  the  PIPs  waj  to  be  made  in  the  applications).    At  least  three 
sites  Saw  a  PIP  adoption  as  a  means  of  complying  with  OCR  regulations. 
Two  sites  emphasized  their  lack  of  experience  and  the  hope  that  the  PIP 
would  provide  the  guidance  they  needed  in  establishing  a  program^  while 
several  others  reported  similar  motivations  in  varying  degrees.    One  site 
was  favorably  disposed  toward  the  PIP  concept  because  of  their  experience 
iu  having  a  local  project  packaged  in  the  original  compensatory'^education*^ 
PIP  study.    Another  was  familiar  with  the  Venceremos  developer  cite  and 
had  a  prior  Interest  In  adopting  at  least  some  of  its  features. 

The  PIP  packaging  concept  had  a  moderately  positive  Influence  in  some 
sites »  biit  may  actually  have  discouraged  ethers.    The  idea  of  having  all 
Iiroject  guidelines  pulled  together  in  one  package  was  attractive^  but  TRCs 
reported  that  the  apparent  restrictions  Imposed  by  the  packages  and  the 
impositions  of  the  field  test  created  unfavorable  reactions  in  some  sites* 
The  evidence  of  effectiveness  and  the  JDRP  approval  were  mentioned  as 
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positive  features  by  some  sites  but  certainly  were  not  a  major  factor  in 
decisions  to  adopt,  since  few  LEA  decision  makers  seem  to  think  in  tenns 
of  transportable  projects  with  associated  transportable  Impacts. 

The  basic  project  features  played  a  major  role  in  determining  the 
market  for  the  PIPs.    All  the  projects  were  for  grades  K  through  4,  all 
had  similar  staffing  patterns,  all  specified  starting  with  the  first  two 
grades  and  expanding  upward  one  year  at  a  time»  and  all  were  for  similar 
student  populations*    None  dealt  ulth  small  groups  of  non-English  students 
or  with  mixes  of  non-English  languages  (see  Appendix  C  for  a  detailed  com*^ 
parison) . 

Grant  applications,  and  USOE  selection  of  field-test  sites.  With 
some  exceptions,  the  LEAs  had  access  to  the  complete  PIPs  in  preparing 
their  Title  VII  grant  app.^.ications.    The  grant-application  process  is 
clearly  a  key  factor  in  a  diffusion  system.    That  is,  grants  may  be  awarded 
to  sites  on  the  basis  of  LEA  proposal-writing  skills  rather  than  on  the 
basis  of  diffusion-system  goals.    This  issue  was  not  addressed  in  the  bi- 
lingual PIP  study,  but  available  USOE  records  show  only  one  PIP  applicant 
for  a  Title  VII  grant  that  had  its  application  rejected. 

Personnel  outcomes  from  dissemination  and  selection  processes.  The 
major  "outcome"  of  the  selection/adoption  stage  was  the  set  of  19  field- 
test  sitefi  with  their  respective  PIP  projects.    From  the  standpoint  oi  the 
RMC  study^  the  important  diffusion-system  results  were  largely  determined 
at  this  point.    Because  of  the  nature  of  the  PIP  projects  and  the  criteria 
used  for  selection,  the  assignment  of  the  three  Spanish-English  projects 
to  sites  could  be  considered  almost  random  in  effect.    The  French-English 
sites,  of  course^  had  no  choice.    The  degree  of  match  between  PXP  projects 
and  adopters  is  considered  here  for  staff.    Compatibility  of  instructional 
approaches,  and  student  population  matches  are  described  under  sections 
7.4.4.3  and  7.4*4*4,  below. 

Staff  availability  was  a  major  discrepancy  in  many  si^es*    ^^ly  eight 
of  the  19  sited  were  able  to  obtain  a  full  sta.!f  cf  qualified  bilingual 


14  i 

0: 


teachers  as  described  in  the  PIPs,  and  three  had  none  available  at  all* 
Since  the  PIP  projects  made  no  provisions  for  unqualified  staff,  substan*- 
tlal  modifications  were  dictated  in  the  relevant  adopter<-sites  * 


7*4*4*2    Other  resources  (the  PIP  image)  ■    Ho  major  selection  or 
development  of  LEA  "other  resources"  occurred  during  selection/adoption, 
but  an  outcome  of  PIP  development,  the  image  of  the  PIP  from  the  perspec- 
tive of  the  target  LEAs,  became  an  important  factor  at  this  stage*    It  is 
implicit  among  the  concepts  of  the  PIP  diffusion  syetem  that  the  PIP  it- 
self will  be  viewed  positively  (or  at  least  not  negatively)  by  the  "  *■ 
LEAs*    In  fact,  as  noted  under  Personnel  (7*4*4*1),  this  was  not  al^ 
true*    The  bilingual-PIP  field  test  confirmed  the  experience  of  the 
compensatory<-education<-PIP  field  tests  that  many  educators  react  nega<- 
tively  to  packaging,  viewing  it  as  an  inflexible  and  simplistic  approach 
to  diffusion* 

7*4*4*3    Plans  and  constraints  (project  selection)*    According  to 
the  conventions  of  the  ?I?  diffusion  model,  the  process  of  choosing  a  par- 
ticular PIP  is  considered  to  be  ^'selection  of  a  plan"  (for  an  LEA  program)* 
The  intended  process  called  for  sitea  to  analyze  the  project  features  as 
described  in  the  ASK  booklets  and,  with  the  assistance  of  the  TRCs,  choose 
the  most  appropriate  project  given  the  local  goals  and  resources*  This 
process  broke  down  rather  badly*    First,  as  discussed  above,  the  projects 
actually  differed  very  little  from  the  perspective  of  an  adopter*  Second, 
the  tiSOE  and  TRC  personnel  had  a  rather  superficial  knowledge  of  the  dif- 
ferences among  the  projects*    Third,  USOE  was  anxious  to  have  at  least 
four  adcpters  lor  f^ach  project*    Finally,  the  total  number  of  applicants 
was  small  * 

T^-.e  net  etfect  was  ttiat  LEAs,  with  TRC  guidance,  chose  largely  on  the 
basis  of  >:he  devexoper-site  student  characteristics  (primarily  the  ratio 
of  LES  CO  PES  sCL*dent3  in  the  schools)  as  described  in  the  ASK,  even  though 
these  factors  were  not  reflected  in  the  instructional  features  of  the  proj- 
ects themselves*    Subsequently,  OBE  Program  Officers  or  TRC  personnel  re- 
quired project  changes  in  at  least  two  of  the  19  sites,  either  to  make  the 
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choices  more  appropriate  In  the  OBE  or  TRC  view,  to  fUl  out  the  field* 
test  schedule,  or  both.    The  more  critical  Implementation  factors,  such 
as  availability  of  appropriate  personnel,  attitudes  toward  bilingual  edu^ 
cation,  or  agreem^t  with  specific  Instructional  methods,  applied  equally 
to  all  the  PIP  projects,  btit  played  little  role  In  the  selection  process. 

Compatibility  of  the  PIP-speclfled  Instructional  approaches  with  LEA 
needs  was  largely  a  matter  of  perspective.    Since  the  PIPs  Included  very 
few  specific  Instructional  techniques,  sites  had  a  great  deal  of  latitude 
with  respect  to  which  approaches  could  be  considered  compatible.    This  was 
helpful  to  many  of  the  adopters,  since  they  had  ongoing  practices  or  poll* 
cles  that  they  did  not  wish  to  change.    In  the  few  areas  where  specific 
approaches  did  differ  among  the  PIPs,  compatibility  with  LEA-deslred  ap- 
proaches was  low.    Perhaps  the  major  example  was  the  team  teaching  approach, 
unique  to  Project  Adelante.    None  of  the  Adelante  adopters  was  Interested 
In  that  feature  of  the  project  and  none  subsequently  Implemented  It.  By 
contrast,  at  least  one  Nuevos  Horlzontes  adopter  was  already  committed  to 
team  ti^achlng,  a  feature  not  Included  In  the  Nt- -  ros  Horlzontes  project, 
and  continued  to  use  It  after  adopting  the  PIP  project. 

The  Impact  of  this  breakdown  In  the  selection  process  was  relatively 
minor  In  the  blllngual~PIP  tleld  test  because  of  the  similarities  among 
the  projects  and  the  extent  to  which  fleld*test  sites  adapted  project 
features  to  meet  local  needs  and  resources.    However,  In  RMC's  judgment, 
an  adequate  selection  process  would  be  a  key  factor  In  any  attempt  to 
diffuse  specific  Instructional  or  management  practices  without  major 
adaptations. 

7.4.4.^    Studmts  (student  selection).    No  processes  actively  affect- 
ing studmts  were  carried  out  during  selection/adoption.    However,  the 
selection  of  sites  Is,  In  effect,  the  first  step  In  selecting  students. 
With  the  exception  of  Puerto  Rico,  the  student  populations  In  the  Spanish- 
English  sites  were  generally  similar  to  those  In  the  developer  sites*  that 
Is,  a  wide  mixture  of  proficiencies  In  both  English  and  Spanish.  Asld^^; 
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from  the  unique  situation  in  Puerto  Rico,  the  only  student-related  dis- 
crepancies that  created  any  real  problems  were  the  small  numbers  of  eli- 
gible students  in  some  adopter  sites*    In  some  of  these  sites^  the  proj*- 
ects  were  too  small  to  support  the  PlP-specif ied  manag«£ment  structure* 

In  the  French- English  sites,  while  project  students  were  generally 
low  in  English  proficiency^  virtually  none  spoke  more  than  a  few  isolated 
words  of  French*    This  substantially  changed  the  complexion  of  the  proj* 
ects  from  that  described  in  the  PIP* 

7*4*5    Smnmary  of  Pro&ress  and  Problems;  Selection/Adoption 

In  summary,  to  the  extent  that  accurate  replication  of  the  developer* 
site  projects  was  a  goal  of  the  PIP  diffusion  system^  it  is  clear  in  re* 
trospcct  that  the  system  was  well  off  course  by  the  end  of  the  selection/ 
adoption  stage*    the  amorphous  nature  of  the  projects  themselves  and  the 
lack  of  match  between  projects  and  adopters  precluded  anything  spproaching 
replication  in  most  sites,  even  in  sites  that  made  a  sincere  effort  to 
replicate  faithfully*    Conversely,  and  again  because  of  the  general  and 
conventional  nature  of  the  PIP  projects^  slmost  any  bilingual  project 
could  be  said  to  include  many  features  of  the  projects  described  in  the 
PIPs»  and  thus  all  field*test  sites  were  able  to  claim  some  level  of 
replication* 

7*4*5*1    DSOE*    During  selection/sdoption  USGE  monitored  the  dissem- 
ination process  and»  when  it  was  apparent  that  target  LEAs  were  not  re- 
sponding »  altered  their  plans  and  intervened  directly  to  ensure  an  ade- 
quate number  of  field-test  sites* 

7*4*5*2    Diff users*    No  msjor  processes  affecting  the  TRCs  operated 
during  selection/adoption*    However^  in  a  few  cases^  USOE  and/or  SEA  per** 
sonnel  interacted  with  the  TRCs»  adding  additionsl,  TRC  dissemination 
activities  to  the  original  dissemination  plans* 
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7.4.5.3    Target  lEAb.    The  Intended  selection/adoption  procesBes  did 
not  operate  as  planned.    Neither  the  proJectB,  aB  packaged,  nor  the  dlB- 
Bemlnatlon  approaches  were  particularly  attractive  from  an  LEA  perBpectlve. 
Very  few  LEAb  reBponded  to  the  nominal  awareness  activities,  and  for  the 
19  BlteB  that  were  eventually  recruited,  selection  among  the  SpanlBh-Engllsh 
projects  was  eBBentlally  random. 
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7.5    Stage  3!  Start-Up 


7#5#1  Overview 

7#5#l#l    Definition  of  Stage  3*    Start-up  is  Intended  to  cover  all 
activities  from  the  time  an  I^EA  submits  Its  Title  VII  grant  application 
until  students  arrive  In  the  hlllngual-^project  classroomB^    In  practice* 
start"*up  workshops  and  other  preparations  were  not  always  finished  by  the 
time  students  arrived*  but  this  overlap  does  not  present  any  real  dlffl* 
cultles  for  the  process  evaluation*    The  overlap  may*  of  course*  cause 
considerable  difficulty  to  an  adopter  site* 

7*5.1*2    Ma,1or  features  and  problem  areas*    The  Intended  start--up 
process*  as  described  In  the  PIP  materials*  called  for  the  following 
activities  to  take  place  In  the  spring  before  project  began  operation: 
(a)  planning*  (b)  orientation  of  LEA  personnel*  parents  and  cominunlty* 
(c)  hiring  of  teachers*  (d)  ordering  of  materials*  and  (e)  staff  training* 
The  major  training  activity*  a  two-week  preservlce  workshop  for  new  pro- 
ject staff*  was  scheduled  for  August* 

Delayed  start-up*    The  OBS  funding  schedule  originally  called  for  LEA 
Title  VII  grants  to  be  awarded  by  the  end  of  April  so  that  field-test  sites 
could  meet  the  Intended  start  up  schedule*    The  actual  awards  and  delivery 
of  PIPs  occurred  In  July  and  August^  too  late  to  brief  school  personnel  or 
hire  teachers  under  the  normal  procedures  In  most  LEAs*    The  cooperative 
review  of  PIP-suggested  materials  by  project  staff*  and  subsequent  ordering 
In  time  for  the  start-up  workshop*  were  also  not  possible.  Preparation 
time  for  the  workshop  was  brief*  and  consultants  were  often  difficult  to 
find  on  short  notice*    Some  sites  had  proceeded  to  plan  and  make  tentative 
staff  assignments  in  the  spring  without  formal  notification  of  grant  ap- 
proval* bi  t  most  were  reluctant  to  expend  much  effort*  and  none  could  make 
flr^i  coDimltm&nts  to  staff  or  order  materials*    The  net  effect  of  ^he  delayed 
start  waa  that  start-^^  activities*  in  fiffect*  overlapped  the  entire  first 
year  of  operation. 
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Lack  of  guidelines  for  permissible  adaptations*    The  delayed  start- 
up was  a  serious  problem*    At  the  time  school  started »  many  adopters  were 
short  of  materlala^  staffs  were  not  all  In  place  (and  were  unavailable  In 
some  sites) »  and  staff  training  was  Incomplete*    However^  there  was  an 
additional  type  of  problem  that  was  In  mauy  ways  even  more  troublesome* 
This  was  the  Ink  of  clear  guldelli^es  as  to  how  closely  the  adopters  should 
be  required  to  follow  PIP  specifications*    This  Issue  Is  discussed  under 
LEA  plans  and  constraints  (7*5*4*3)* 

Variations  In  bilingual  program  experience*    A  third  major  factor  In 
the  start-up  stage  (and»  subsequent.-/^  In  operation)  was  the  variation 
among  field-test  sites  In  their  previous  bilingual  program  experience* 
This  variation  was  reflected  In  the  LEA  uses  of  the  PIPs  In  overall  plan- 
ning»  In  selecting  and  training  stafi.^  and  In  selecting  materials*  Spe- 
cific Issues  related  to  level  of  experience  are  Indicated  undc^r  the  appro- 
priate headings^  below* 

The  major  start-up  prc£«T  :ms  and  Issues  are  listed  In  Figure  12*  Starts 
up  activities  were  concentrated  under  "developing  or  modifying  program 
plans/'  and  "orienting^  selecting  and  training  perironnel**' 

7*5*2    Start-Up  Activities  Affecting  USOE 

7*  5*2*  1    USOE  personnel  (information  on  stari:-uP  problems)*  With 
the  award  of  the  LEA  Title  VII  grants^  the  OBL  program  officers  became 
the  primary  USOE  contacts  for  the  fleld-^tesf:  sites*    Four  program  officers 
were  Involved^  each  responsible  for  from  four  to  sevon  PIP  sites*  However^ 
each  program  officer  was  also  responsible  for  a  large  number  of  regular 
Title  VII  grantees^  In  some  cases  fifty  or  more  sires  In  total*    This  heavy 
case  load  precluded  extensive  monitoring  or  consulting  and*  In  addition^ 
limited  OBE  travel  funds  prevented  frequent  visits  to  the  sites* 

Within  this  context^  the  major  processes  affecting  USOE  personnel 
during  start-up  were  related  to  obtaining  Information  on  the  progress  of 
the  field  test*    To  RMC's  knowledge^  no  formal  "Intended"  fe-^^hack 
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stage  3;    Start*Up  (7*5) 


TJ80E  (7*5*2) 

Personnel  (7*5*2*1) 

•  Information  or  start-up  problems 

Other  resources  (7*5*2*2) 

•  Travel  funds 

Plans  and  constraints  (7*5*2*3) 


Diffusers  (7*5*3) 

^0  major  activities  affecting  diffusers 


LEAs  (7*5*4) 

Personnel  (7*5*4*1) 

•  Delayed  start  dates 

•  Orientation 

•  Hiring  of  staff 

•  Preservice  workshops 

•  Incentives  and  competing  influences 

Other  resources  (7*5*4*2) 

•  Ordering  of  materials 

Plans  and  constraints  (7*5*4*3) 

•  Guidelines  for  adapting  the  PIP  projects 

•  Bffects  of  prior  bilingual** education  experience  on  program 
planning 

•  PIP-specified  instructional  objectives 

Students  (7*5*4*4) 

•  No  major  activities  affecting  students 


Figure  12*    Actual  PIP  diffusion  systemt    Stage  3  key  issues* 
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procedures  were  developed »  presumably  ci  the  assumption  that  normal  OBE 
contacts  vis  telephone  and  mail  would  be  sufficient*    However »  the  actual 
procedures  included  two  meetings  in  August^  both  scheduled  on  relatively 
short  notice  and  held  in  the  Washington^  D*C*  area* 

The  first  meeting  was  held  between  USOE  (OBE  and  OPBE)  and  RMC  in 
early  August  1977»  shortly  after  the  award  of  the  RMC  study  contract^  to 
discuss  plans  for  the  field-test  study.    The  second  meeting  Was  held  at 
the  end  of  August  and  included  the  field-test-site  project  directors  and 
evaluators*    Various  topics  were  discussed^  including  the  general  status 
of  start-up  in  the  field-test  sites* 

As  a  result  of  these  meetings  and  the  additional  phone  and  mail  con*- 
tacts  with  the  sites^  USOE  was  relatively  well  informed  as  to  the  status 
of  start-up*    The  information  available  to  USOE  was  that  there  wa?  consi*- 
derable  confusion  in  the  field-test  sites  due  in  part  to  the  delay  in 
grant  awards »  and  in  part  io  ambiguity  as  to  exactly  what  USOE  required 
of  the  sites  (see  7*5*4*3}*    These  problems  were  clearly  adding  to  the 
normal  difficulties  of  developing  new  programs  and  were  symptomatic  of 
the  more  general  diffusion-system  problems  discussed  under  the  preceding 
stages*    However^  while  USOE  was  informed  as  to  the  problems^  few  remedies 
were  available  to  USOE  by  this  time* 

7*5*2*2    Other  resources  (travel  funds)*    Ho  development  of  USOE 
materials  or  facilities  was  planned  for  start-up  and  none  was  needed* 
Lack  of  travel  funds^  however^  was  u  problem*    As  start^-^up  activities 
continued  through  the  fall  (overlapping  with  operation) »  restricted  travel 
funds  delayed  program-officer  site  visits  until  November  in  many  cases 
and  thus  delayed  the  resolution  of  many  local  issues* 

7*5*2*3    Plans  and  constraints*    No  major  adjustments  to  plans  for 
USOE  participation  were  intended  and  none  occurred  during  start-up* 
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7*5*3    Start-up  Activities  Affecting  Dlffuaera 


No  major  processes  affecting  diffusion  personnel^  other  diffusion 
resources^  or  diffusion  plans  and  constraints  were  Intended  or  occurred 
during  start-'Upt    Diffusion  personnel  £rom  TRCs  were»  however^  Involved 
In  some  LEA  training  and  planning  activities* 

7*5*4    Start-Hp  Activities  Affecting  Target  LEAs 

7*5*4*1    LEA  personnel*    Personnel  orientation^  selection^  and  train* 
ing  were  the  major  Intended  and  actual  LEA  start-up  activities*    All  were 
affected  by  the  delayed  start  dates* 

Delayed  start  dates*    The  Intended  sequence^  as  described  In  the  PIPs^ 
waa  for  the  project  director  (PD)  to  be  hired  by  early  spring*    The  FD 
would  then  orient  all  personnel  (Including  principals^  potential  project 
staffs  and  parents  and  the  community) »  recruit  the  project  staffs  order 
materials^  and  conduct  a  staf f-'tralnlng  workshop^  all  before  the  beginning 
of  classes  In  the  fall*    Huwever^  due  to  the  delayed  start*  some  sites  did 
not  actually  start  project  Implementation  until  after  the  beginning  of 
classes*    Six  sites  did  not  hire  project  directors  until  after  classes 
had  started*    In  fact»  one  of  these  sites  did  not  begin  project  operations 
until  two  months  Into  the  school  year;  another  site  did  not  get  underway 
until  mid-year*    At  least  five  sites  did  not  hire  an  Insti'uctlonal  conr* 
sultant  prior  to  the  start  of  classes*    Of  these*  one  was  hired  four  months 
Into  the  school  year;  two  others  were  hired  five  and  six  months  late*  In 
summary^  about  one-third  of  all  the  PIP  adopter  sites  did  not  hold  project 
start-up  workshops  or  get  underway  prior  to  the  beginning  of  classes* 

Orientation*    The  PIP  recommended  that  the  PD  orient  all  LEA  per** 
sonnel^  parents^  and  commmunlty  to  the  goals  and  purposes  of  the  project* 
Orientation  of        personnel^  parents^  and  community  was  a  start-up  actlv^ 
Ity  that  was  only  nominally  done^  In  large  part  because  of  the  delayed 
start-up*    Some  FDs  made  a  presentation  about  their  project,  at  district- 
wide  pre-servlce  workshops;  some  LEAs  also  made  some  attempt  to  notify 

150 


90 


parents  of  the  project  as  part  of  their  student  selection  activities  dur- 
ing start-up*    For  the  most  part,  the  commmltv  as  a  whole  was  not  Infonoed 
about  the  project  prior  to  operation,  with  the  possible  exception  of  a  few 
sites  where  a  local  newspaper  announced  the  award  of  the  project  grant  to 
the  LEA.    Although  reception  of  the  programs  was  generally  positive,  there 
were  some  negative  reactions  In  some  sites  that  mlghc  have  been  reduced  by 
additional  orientation* 

Hiring  of  staff.    The  PIPs  recommended  that  the  best  teachers  In 
the  district  be  Identified  and  that  teachers  were  to  volunteer  for  the 
project.    For  the  most  part,  PIP  adopters  Implemented  the  project  With 
staff  already  available  at  the  LEA.    In  most  cases  where  the  LEAs  had  had 
pre-^lstlng  projects,  the  teachers  from  these  projects  became  the  PIP*- 
project  teachers.    In  a  few  LEAs ,  some  teachers  were  hired  from  outside 
the  district  to  staff  the  project^  but  In  no  Instance  were  all  of  the 
project  teachers  newly  hired  Into  the  LEA*    It  Is  actually  more  appropriate 
to  speak  of  teachers  being  selected  and/or  assigned  to  the  project  than 
to  speak  of  hiring  project  teachers  or  of  teachers  volunteering. 

Hiring  of  other  project  staff  members  generally  followed  PIP  guide** 
lines*    Instructional  coordinators  were  hired  In  most  sites,  as  specified 
In  the  PtPs,  as  were  bilingual  aides*    In  fact,  the  nominal  staff  confi- 
guration was  the  one  area  In  which  the  PIPs  appeared  to  have  a  major  impact 
although,  of  course,  the  aides  are  a  common  feature  of  most  Title  VII 
programs^    Some  sites  did  not  follow  the  guidelines  for  community  coordl^ 
nators  (either  hiring  where  none  was  called  for,  or  not  hiring  \)here  one 
was  specified  In  the  PIP),  and  some  sites  adapted  the  duties  of  these 
personnel  to  meet  local  needs* 

Preservlce  workshops.    The  preservlce  workshop  was  the  mechanism 
Intended  to  orient  and  train  the  new  project  staff,  and  get  the  project 
off  the  grcmd*    It  was  scheduled  for  late  August,  and  the  PD  was  In- 
tended to  have  several  months  In  which  to  prepare*    The  workshop  was 
Intended  to  be  highly  applied  rather  than  theoretical,  and  to  be  focused 
on  the  specific  tasks  that  would  be  required  of  teachers  and  aides  during 


the  first  few  weeks  of  project  operation*    In  shorty  the  workshop  was 
a  key  link  in  transferring  the  exacts  exemplary  procedures  t*?ed  in  the 
developer  site  over  to  the  staff  of  the  new  adopter  site* 

While  ell  sites  held  some  form  of  workshops  two  factors  drastically 
reduced  the  e*ffectiveness  of  this  transfer  process*    The  first  was  the 
lack  of  preparation  time  available  to  the  PDs*    In  at  least  one  site»  the 
workshop  was  held  before  the  PIP  arrived*    Few  sites  had  their  PIPs  for 
more  than  a  week  or  two  prior  to  their  workshops »  and  none  had  the  time 
to  prepare  as  intended* 

The  second  factor  was  the  nature  of  the  Information  contained  in 
the  bilingual*PIP  workshop  guide*    As  with  othir  bilingual-PIP  materials » 
the  information  and  guidelines  were  rather  general*    The  PIP  described 
the  topics  to  be  covered^  but  not  ^cactly  how  the  workshop  sessions  should 
be  conducted  or  what  specific  content  to  include*    For  many  topics^  the 
PIP  guidelines  were  identical  acroas  the  four  PIPs*    This  approach »  which 
was  basically  to  provide  for  "staff  development"  in  various  areas  of  bi- 
lingual education^  was  consistent  with  the  general  nature  of  the  project 
guidelines  used  in  the  developer  sitea»  but  not  with  the  concept  of  dif^ 
fusing  specific^  exemplary  practices* 

The  result  was  that  there  was  great  variation  in  the  workshops  from 
site  to  site*    Experienced  PDs  provided  training  sessiona  adapted  from 
previous  years*    Among  the  inexperienced  PDs»  many  relied  heavily  on  out*-* 
side  consultants »  most  of  whom  presented  their  own  approaches  to  bilingual 
education^  and  none  of  whom  (to  BMC's  knowledge)  made  any  real  uoe  of  PIP 
guidelines*    Experienced  teachers  and  aides  in  sites  with  experienced  PDs 
generally  had  positive  attitudes  and  a  clear  idea  of  how  to  proceed  with 
program  operation^  although  there  was  little  influence  from  the  PIPs*  In 
some  of  the  less  experienced  sites»  the  PIPs  had  somewhat  more  impact^  but» 
in  general^  the  teachers  and  aides  were  not  well  prepared  at  the  beginning 
of  operation*    Some  were  spprehensive  and»  in  a  few  cases»  even  negative 
toward  the  programs* 
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Incentives  and  competing  Influences*  Implicit  In  the  above  discus- 
sion and  In  the  discussion  of  plans  and  constraints »  below^  Is  the  Issue 
of  what  ctotlvated  or  Influenced  the  fleld-test*slte  personnel  to  follow 
the  PIP  guidelines  or  to  follow  other  guidelines*  This  study  considered 
only  the  most  obvious  factors^  but  they  are  clearly  critical  to  the  sue*- 
cess  of  a  diffusion  system* 

The  "Intended"  motivation  to  follow  FIP  guidelines  was  simply  the 
validated^  exemplary  status  of  the  projects*    Ifowever^  this  and  previous 
PIP  field  tests  demonstrate  that  exemplary  status  carries  little  weight* 
The  typical  educator  considers  herself  or  himself  as  a  professional  who 
can  best  Judge  which  approaches  will  suit  local  conditions*    Most  educa*- 
tors  feel  that  each  LEA  context  's  unique*    The  concept  of  vhole**project 
adoption  Is  completely  alien  to  most  educators  and  Is  Widely  considered 
absurd* 

At  the  same  tlme»  the  typical  educator  receives  a  constant  stream 
of  Ideas  from  colleagues »  professional  groups^  commercial  organizations^ 
and  so  on*    The  educator  considers  these  Inputs  within  the  context  of 
the  constraints  from  relevant  lavs»  regulations »  and  policies »  and  then 
develops  the  best  possible  cmblnatlon  of  program  features^  according  to 
his  or  her  professional  Judgment* 

This  description  Is  Intended  only  as  a  statement  of  the  obvious^  but 
It  serves  to  Illustrate  a  major  problem  In  the  PIP  concept*    That  ls» 
the  local  educator  cannot  be  expected  to  follow  PI?  guidelines  closely 
unless  she  or  he  can  be  convinced  that  this  will  lead  to  the  best  possl*- 
ble  program  (and  we  are  aware  of  no  way  to  do  this) >  or  unless  strong 
Incentives  are  pro^^lded  such  as  strictly  enforced  regulations^  or  funding 
contingent  upon  careful  replication  of  program  features*    The  latter  has 
teen  shown  to  work  quite  well  In  Study  2>  the  field-test  of  the  proto- 
type »  compensatory**educatlon  PIPs* 

7*5*4*2   Othsr  resources  (ordering  of  materials) *    The  lack  of 
facilities  or  funds  during  start-'up^  while  affecting  some  fleld*test 
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sites »  were  not  key  problemfl  from  a  dlffuslou  standpoint.    The  ordering 
of  materlalfl^  however,  waa*    The  PIP  suggested  that  the  project  staff 
cooperatively  review  the  PlP-recommended  materlalfl*    Due  to  the  late  atart^ 
the  review^  selection^  and  ordering  of  project  infltructional  materials  waa 
compreflfled  into  a  very  brief  period*    Sites  that  had  a  prior  bilingual- 
education  project  relied  extensively  on  materials  already  available  at  the 
LEA*    Other  sites  were  influenced  by  neighboring  LEAs»  SEA  recommendations 
or  the  preferences  of  their  staff*    About  half  of  the  sites  did  order  some 
of  the  PlP-recommended  materials*    However »  with  only  a  few  exceptions » 
most  projecta  were  unable  to  select  and  order  new  materials  before  the 
beginning  of  classes* 

7*5*4*3    Plans  and  constraints*    No  major  changes  to  plans  or  con- 
straints were  included  among  the  intended  start-up  processes  and  outcomes* 
The  need  for  extensive  development  of  LEA  program  plans  was  presumably  * 
eliminated  by  the  PIPs *    Legal  and  other  constraints  on  start-up  activi- 
ties were  not  considered  in  the  PIP  diffusion  plans »  and  tio  provisions 
for  modifying  either  the  PIP  plans  or  the  constraints  were  included* 

In  factf  the  actual  start-up  stage  included  major  changes  to  the  PIP 
plans  to  fit  local  needs  and  resources*    In  addition^  state  and  local  laws 
and  regulations  governing  objectives^  hiring  policies^  instructional  materi- 
als »  and  so  on  often  conflicted  with  PIP  specif ications »  thus  requiring 
further  modification  of  the  plans* 

Guidelines  for  adapting  the  PIP  projects*    As  noted  above,  the  PIP 
projects  did  not  lend  themselves  to  ready  identification  of  key  features^ 
so  it  was  difficult  to  establish  gtddelines  on  permissible  adaptations* 
While  USOE  wished  to  preserve  the  concept  of  replication  as  much  as  pos- 
sible for  the  purposes  of  the  field  test »  no  one  wanted  to  Impose  arbi- 
trary requirements  on  the  sites  that  would  clearly  hurt  their  chances  for 
success  * 

Toward  the  end  of  August,  a  meeting  was  held  by  USOE  in  Silver  Spring, 
Maryland  for  all  adopter-site  project  directors  and  evaluators  as  well  as 
for  the  SMC  evaluation  staff*    At  this  meetings  the  project  directors  wera 
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urged  to  follow  the  PIPs  closely  but  to  adapt  to  local  conditions  "where 
necessary**'  Interpretation  of  this  guideline  varied  widely^  adding  a  con- 
siderable amount  o£  noise  to  the  BHC  study^  and  resulting  in  confusion 
and  negative  attitudes  on  the  parts  of  some  project  directors* 

Effects  of  prior  bilingual* education  experience  on  program  planning* 
Eleven  of  the  19  field*test  sites  had  had  previous  bilingual  programs 
of  some  sort*    Hine  of  these  11  sites  had  previously  received  state  bi*- 
lingual  funds^  four  had  received  local  fundings  and  four  had  received 
Title  VII  grants*    Several  of  these  sites  had  received  funds  from  two 
of  the  three  sources^  and  one  site  had  received  funds  from  all  three* 
In  addition  I  three  of  the  11  sites  had  Title  I  or  Title  I  migrant  pro- 
grama  offering  services  to  limited-Bnglish-proficiency  students* 

Of  the  11  sites  with  previous  bilingual^-educatlon  programs^  four 
essentially  replaced  their  programs  with  the  PIP  programs*    The  other 
seven  sites  extended  services  to  more  children  and/ or  extended  the  number 
of  hours  per  day  that  services  were  offered*    Of  the  eight  sites  that  had 
not  had  formal  bilingual- education  programs »  at  least  four  had  implemented 
some  form  of  services  for  llmited**English**i:roficiency  students  and  had 
this  experience  to  draw  upon*    Only  four  of  the  19  sites  could  be  described 
as  having  new  programs  together  with  project  directors  who  had  little  or 
no  previous  bilingual**education  experience* 

The  impact  of  this  previous  experience  on  program  planning  was  that 
none  of  the  field**test  sites  viewed  the  lack  of  specific  plans  in  the 
PIPs  as  catastrophic*    Where  the  PIPs  were  incomplete  or  in  conflict  with 
regulations  I  the  PDs  simply  adapted  as  necessary*    In  some  cases »  it  would 
be  more  accurate  to  say  that  the  PDs  implemented  bilingual  programs  using 
their  own  plans »  adapting  them  as  necessary  to  conform  to  PlP^specified 
staffing  configurations  or  other  salient  features* 

PlP'^specified  instructional  objectives*    In  any  attempt  to  transfer 
the  exemplary  characteristics  from  the  developer  to  the  adopter  sites, 
the  Instructional  objectives  would  appear  to  constitute  an  especially 
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Important  subset  of  the  project  plane*    All  four  bilingual  PIPe  Included 
Instructional  objectives  from  the  developer  sites  and  three  of  the  PIPs 
Included  separate  manuals  on  Instructional  objectives*    In  general,  the 
Instructions  were  to  review  the  objectives  and  adapt  them  as  necessary 
to  fit  local  goals  and  curricula* 

Virtually  all  sites  attempted  some  review  of  the  instructional  ob- 
jectives in  the  PIPs  but,  in  general,  they  used  the  PIP  objectives  as 
inputs  to  supplement  existing  state  or  local  objectives  rather  than 
adopting  them  as  they  stood*    &y  and  large,  project  staffs  felt  the  PIP- 
specified  objectives  were  not  detailed  enough,  and  several  sites  felt 
their  preexisting  objectives  were  better* 

7*5*4*3    Students*    In  both  intended  and  actual  implementation, 
selection  of  students,  a  key  process,  may  occur  before  the  end  of  start^ 
up*    However,  since  student  selection  is  a  regular,  yearly  project  activ*' 
ity,  it  is  included  in  the  PIP-dif fusion  model  under  ^'operation  *** 

7*5*5    Summary  of  Progress  and  Problemsi  Start-Up 

By  the  end  of  start-up,  the  major  Impacts  of  the  PXPs  were  on  staff 
configurations,  materials,  and  development  of  instructional  objectives* 
Most  sites  hired  staff  with  the  nominal  titles  given  in  the  PIPs  (i*e*, 
instructional  consultants,  curriculum  coordinators,  and  so  on)*    All  hired 
aides*    Some  sites  ordered  materials  specified  in  the  PIP  lists,  others 
reviewed  the  lists  and  chose  to  use  materials  on  hand,  or  made  up  their 
own  revised  lists  based  on  their  past  experience,  ^ile  still  others  were 
influenced  by  outside  sources  to  order  (luite  different  materials* 

7*5*5^1    USOE*    Although  time  and  funding  restrictions  prevented 
OBE  program  officers  from  visiting  most  of  the  field-test  sites  during 
the  early  start-up  stage,  USOE  was  reasonably  veil  informed  as  to  the 
progress  and  problems  in  the  sites*    Other  than  this  feedback,  no  key 
processes  affecting  USOE  were  intended  or  occurred  during  start-up* 
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7*5*5*2    Dlffusers*    Ho  key  processes  affecting  dlffusers  were  sche*^ 

duled  for  this  stage*  although  some  of  the  TRCs  monitored  the  progress 

of  the  adoptions  In  their  regions  and  were  adequately  Informed  as  to  when 
assistance  was  needed* 

7*5*5*3    Target  LEAs*    The  major  processes  operating  during  this 
stage  affected  the  LEA  personnel,  other  resources,  and  plans*    The  over- 
riding factor  that  precluded  the  operation  of  these  processes  as  Intended 
was  the  delayed  start  date*    The  PIP  called  for  the  PD  to  begin  start-up 
In  early  spring  so  that  (a)  orientation  could  be  carried  out  and  support 
obtained  from  the  school*  parents*  and  communlty>  (b)  staff  could  be  hired* 
where  needed,  during  the  spring  when  they  were  available,  (c)  materials 
could  be  ordered  In  time  for  delivery  before  the  August  preservlce  trork- 
shop,  (d)  careful  analysis  of  the  PIP  project  could  be  completed  and 
adaptations  made,  where  needed,  prior  to  the  preservlce  workshop,  and  (e) 
careful  preparation  for  the  workshop  could  be  made* 

Instead,  PIPs  and  Title  VII  grants  were  received  In  late  July  or 
early  August,  and  none  of  the  Intended  processea  were  possible*  The 
results  were  predictable  and,  as  discussed  In  the  next  section,  resulted 
In  considerable  delay  and  confusion  during  the  Initial  period  of  operation* 
However,  It  will  also  be  seen  that  the  resulting  problems  were  temporary* 
In  effect,  most  of  the  intended  processes  operated  during  the  first  year 
and,  by  the  beginning  of  the  second  year,  the  Impacts  of  the  delay  were 
minor*    In  short,  the  result  of  the  delayed  start**up  was  to  make  the  first 
year  of  operation  unnecessarily  difficult*    However,  unlike  many  of  the 
problems  discussed  under  the  previous  stages,  this  delay  would  probably 
not  be  crippling  to  the  long-term  outcomes  of  a  PIP  diffusion  system* 

By  contrast,  the  processes  related  to  plans  and  constraints  were 
major  breakdowns  In  the  PIP  diffusion  system*    Ho  provisions  were  included 
among  the  Intended  processes  for  dealing  with  the  constraints  of  state 
and  local  laws,  regulations,  and  policies*    Ho  Incentives  to  follow  PIP 
guidelines  closely  were  provided,  and  field-test  sites  modified  the  PIP 
project  plans  (Including  Instructional  objectives)  as  necessary  to  fit 
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locsl  conditions*    In  terms  of -developing  effective  locsl  programs,  msny 
of  these  modifications  were  certainly  desirable*    From  the  perspective  of 
the  evaluation  of  the  PIP  diffusion  system^  the  modifications  reflected 
major  system  flaws* 
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7,6    Stage  4;  Operation 


7,6,1  Overview 

7,6,1,1    Definition  of  Stage  4^    The  final  stage  lii  this  analysis 
begins  with  the  arrival  of  students  In  the  project  classrooms.    Of  course > 
this  Is  only  the  beginning  of  continuing  program  development.  However^ 
for  the  purposes  of  analysis^  the  changes  over  the  first  two  years  can 
be  collapsed^  becaiise  the  mi^or  considerations  from  a  diffusion  perspec- 
tive are:    (a)  whether  key  features  are  Implemented  at  all  (on  any  reason- 
able time  schedule) I  and  (b)  whether  these  features  are  retained  In  the 
adopter-site  programs, 

7,6,1*2    Major  features  and  problem  areas.    The  principal,  "Intended'* 
characteristics  of  operation  were  that  the  adopter-site  programs  (a)  would 
be  Implementd  quickly  and  smoothly  and  (b)  would  duplicate  the  exemplary 
features  of  the  developer  site.    The  net  effect  of  the  delayed  start-up 
was  that  projects  were  far  from  completely  operational  at  the  time  opera- 
tion began,  and  gradually  completed  the  planning,  hiring  and  training  of 
staff,  and  ordering  of  materials  as  the  year  progressed.    While  life  was 
hectic  for  project  staff  during  the  early  months,  most  seemed  to  accept 
this  rate  of  progress,  and  the  long-tarm  Impacts  of  the  late  start  were 
probably  minimal  In  most  sites.    These  problems  were  described  under 
start-up,  above. 

The  focus  of  this  section  Is  on  the  extent  to  which  the  developer- 
site  procedures  and  outcomes,  as  described  In  the  PIPs,  were  duplicated 
In  the  adopter-sites.    The  conclusion  reached  Is  that,  while  many  sites 
establl^ed  bilingual  programs  that  meet  current  standards  for  desirable 
features,  the  Influence  of  the  PIPs  (over  and  above  Title  VII  and  other 
available  guidelines)  was  rather  small.    Project  specifications  from  the 
four  PIPs,  as  well  as  Individual,  f leld*test-slte  program  descrljjtlons, 
are  summarized  In  Appendices  C  and  A,  respectively.    This  sect''^  -t  t^umms^ 
rlzes  the  Intended  and  actual  program  features  and  dlscussef^  z  .e  influ- 
ences of  the  PIPs  on  the  actual  features.    Following  the  conventions  of 
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the  diffuslou  aod&l»  the  major  areas  considered  fall  under  "personnel 
training  processes  snd  outcomes'*  (T^S^Stl)*  and  '^student  selection  snd 
training^  processes  and  outcomes'*  (7*6*3*^)*    The  specific  topics  are 
listed  in  Figure  13* 

7*6*2    Activities  Affecting  PSOE  DurinR  Operation 

PlP^study  Intpsct  op  PSOE  Plans  for  Paclcaging^    The  majot  processes 
affecting  PSOK  during  operation  involved  feedback  on  the  status  of  the 
field*-test*-8ite  programs*    These  processes  consisted  primarily  of  normal 
PSOE  monitoring  activities,  with  the  addition  of  reports  from  the  BMC 
studies*    This  feedback  had  relatively  little  Impact  on  the  field  test, 
but  has  had  s  uajor  Impact  on  USOK  plans  for  diffusion  via  PIPe*  It 
particular,  plans  to  proceed  with  further  PIP  d€\^elopment  or  PIP*-based 
dif fission  approaches  have  been  dropped «    The  use  of  packaging »  however, 
has  been  added  to  the  NDli  diffusion  system  and,  while  the  Wft  packages 
are  tailored  to  NDli  needt?  md  thus  differ  from  the  PIPs,  the  IfDH  packaging 
guidelines  hsve  been  influenced  by  the  three  PIP  field  tests* 

7*6*3    Activities  Affecting  Diffusers  Duritig  Operation 

SomJ  of  the  TACs  were  involved  in  training  field-test-site  person- 
nel during  operation,  but  no  major  diffusion-system  Impacts  on  the  TRCs 
were  intended  or  occurred* 

7*6*4    Activities  Affecting  Target  LEAs  During  Operstion 
7*6*4*1    LEA  personnel* 

PSOE  and  TRC  inputs*    USOE  and  the  disseminators  (TRCs)  continued 
to  be  active  during  the  operation  stage*    Some  TRCs  followed  up  preser- 
vice  workshops  with  classroom  observation  c^d  then  designed  inservice 
workshops  accordingly,  or  participated  sctively  in  r^ulsrly  scheduled 
training  sessions*    OBE  program  officers  met  with  project  directors  at 
conferences,  consulted  by  telephone  on  matters  of  compliance,  and  visited 
some  sdopter  sites  in  the  late  wi.nter  and  spring* 
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 stage  4;    Operation  (7*6) 

PSOE  (7*6*2) 

•  PIP-study 

•  Impact  on  USOE  plans  for  packagir^ 


Diffusers  (7*6*3) 

•     No  majorf  relevant  impacts  on  TRCs 


Target  LEAs  (7*6*4) 

Personnel  (7*6*4*1) 

•  USOE  and  TRC  inputs 

•  Management  style 

•  Staff  configuration 

•  Staff  skills 

•  Staff  roles 

•  Staff  development 

•  Parent  and  community  knowledge  and  attitudes 

Other  resources  (7*6*4*2) 

•  Instructional  materials 

•  Facilities  and  funds 

Plans  and  constraints  (7*6*4*3) 

•  PIP  versus  other  Influences  on  program  plans 

Students  (7*6*4*4) 

•  Class  configurations 

•  Student  selection 

•  Instruction  of  students 

-  Instructional  objectives 

-  Language  of  instruction 

-  Instructional  approaches 


Figure  13*    Actual  PIP  diffusion  system:    Stage  4  key  issues* 
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In  general*  however^  this  technical  support  did  not  contribute  greatly 
toward  accurate  replication  of  developer- site  prnjects*    The  TRCs^  by  and 
large^  did  not  use  the  PIPs  in  developing  their  technical  assistance  ac^ 
tivitiest    The  OBE  program  officers  were  concerned  about  replication  but^ 
due  to  the  general  level  of  description  in  the  PIPs  and  the  realities  of 
local  conditions^  there  was  no  eaay  way  to  deal  with  replication  as  a 
compliance  issue*    Then  too^  the  program  officers  had  heavy  monitoring 
loads  in  addition  to  the  7IP  adopter  sites ^  and  were  never  in  a  position 
to  provide  intensive  technical  assistance* 

Management  style*    The  management  styip  Is  a  salient  feature  of 
exemplary  programs^  and  the  PIPs  placed  considerable  emphasis  on  thb 
intended  style*    However^  the  actual  management  styles  in  the  adopter 
sites  depended  almost  entirely  upon  the  local  project  directors^  and  upon 
local  policies*    The  major  impact  of  the  PIPs^  as  noted  above^  was  in 
defining  project  staff  positiona^  and  the  simple  existence  of  the  various 
support  personnel^  such  as  instructional  coordinators^  determined  nominal 
lines  of  authority  and  affected  delegation  of  authority  to  some  extent* 

All  PI^B  attempted  to  maintain  communication  with  the  district  office^ 
par^ts^  and  the  community^  although  again^  it  would  be  misleading  to  say 
that  they  replicated  specific  activitiea  carried  out  by  the  developer 
sites  * 

Staff  configuration^    The  PIPs  specified  a  particular  staff  confi- 
guration and  qualifications  for  the  project  staff*    All  projects  nomi- 
nally had  a  project  director^  teachers^  and  teacher  aides*    However^  dif- 
ferences in  staffing  configurations  appeared  among  the  project's  support 
staff «    Two  of  the  19  projects  matched  the  PIP-specif led  configuration 
for  all  their  staffs  while  five  of  the  19  sites  had  support  staff  config- 
urations, that  were  mostly  disaimilar  from  the  PIP  specifications*  The 
rmainder  of  the  sites  had  some  combination  of  PIP  and  non-PIP  config- 
urations * 

Staff  skills^    In  the  area  of  staff  qualifications >  the  adopter 
sites  varied  from  the  PIP-specif led  qualifications  in  substantial  ways. 
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Thirteen  of  the  project  directors  had  no  prior  administrative  experience, 
as  required  by  the  PIPs,  although  about  12  of  the  19  project  directors 
had  prior  experience  In  and  knowledge  of  bilingual  education*    The  In- 
structional coordinator  (IC)  staff  position  required  a  person  that  was 
very  knowledgeable  In  bilingual  education*    Ten  of  the  ICs  met  this  cri- 
terion* 

The  PIPs  required  all  project  teachers  and  aides  to  be  bilingual* 
Hlne  of  the  19  sites  had  complete  staffs  of  bilingual  teachers  during  the 
first  year  of  Imlementatlon*  but  only  five  sites  had  all  bilingual  teachers 
during  the  second  year  as  the  project  expanded  Into  another  grade*  Four- 
teen of  the  adopter  sites  had  all  bilingual  teacher  aides  the  first  year* 
but  only  ten  sites  had  all  bilingual  aides  the  second  year* 

Staff  roles*    The  piPs  specified  particular  roles  for  all  of  the 
designated  project  staff*    With  the  possible  exception  of  one  site,  the 
roles  of  the  project  support  staffs  were  not  completely  congruent  with 
the  PIP  specifications*    It  Is  clear  from  the  site  data  that  the  local 
LEA  practices  and  preferences*  Including  the  L&As'  prior  experience  In 
bilingual  education  and  the  LEAs'  access  to  bilingual  education  training 
resources^  were  the  major  influences  in  shaping  the  roles  of  the  projects' 
support  staffs*    Local  conditions  and  policies  often  prevented  adherence 
to  PlP^'Specif led  roles  for  teachers  and  teacher  aides,  as  well  as  support 
staff)  although  there  was  a  greater  degree  of  congruence  in  the  cases  of 
teacher  and  teacher  aide  rcles* 

All  the  PIPs  specified  that  the  teachers  conduct  bilingual  classroom 
instruction*    Because  not  all  teachers  in  the  adopter  sites  were  bilingual* 
this  specification  was  adapted*    In  the  case  of  the  French /English  pip 
sites*  the  project  teachers  conducted  all  English  language  instruction 
and  the  aides  and/or  French  foreign  associates,  conducted  all  the  French 
instruction*    In  Puerto  Rico,  the  teacher  conducted  all  Instruction  in 
Spanish  and  the  aides  conducted  all  English**language  instruction*    In  one 
site  that  had  many  English-monolingual  teachers,  the  aides  conducted  most 
of  the  Spanish^'language  Instrurtion*    In  the  remaining  sites*  the  teachers 
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did  conduct  blMngual  instruction^  especially  in  kindergarten  and  first 
grade*  By  the  end  of  the  second  grade^  RMC  observed  that  in  most  sites 
instruction  in  Spanish  was  largely  limited  to  Spanish  reading* 

The  PIPs  specified  various  additional  tasks  for  teachers^  such  hs 
developing  objectives »  developing  materials »  and  providing  individualised 
objectives^  but  the  exact  liat  varied  across  the  PIPs*    For  some  sites^ 
the  existence  of  a  PIP  specification  (e*g*»  grouping  or  individualization) 
provided  the  impetus  for  changes  in  the  teachers^  role  and  in  classroom 
procedure*    However^  because  all  of  the  tasks  are  commonly  assigned  to 
teachers^  many  were  already  being  done*    Conversely^  the  absence  of  a  task 
specification  in  one  PIP  did  not  mean  that  teachers  in  adopting  sites  did 
not  engage  in  that  task* 

The  role  of  the  teacher  aides  is  described  slightly  differently  in 
each  of  the  four  PIPs*    Only  two  of  the  PIPs  specified  that  aides  asaist 
with  classroom  instruction*    However*  because  the  role  of  the  aide  is  usu* 
ally  defined  by  individual  school  districts*  aides  in  most  sites  assisted 
the  teacher  with  instructional  tasks  in  addition  to  tutoring*  maintaining 
records*  and  preparing  materials*    Teacher  aides  in  three  of  the  19  adopter 
sites  were  restricted  to  non-instructional  roles  by  state  law* 

The  aides  in  sites  lacking  bilingual  teachers  assumed  additional 
instructional  responsibilities  as  described  above*    In  all  of  the  sites* 
the  roles  of  the  aides  depended  more  on  local  conditions  than  on  the  de- 
scription in  the  particular  PIP  selected* 

Staff  development*    The  PIPs  specified  staff  development  as  a  central 
feature  of  the  projects*    Each  PIP  included  a  fairly  detailed  schedule  for 
the  teachers^  preservice  workshops  and  somewhat  more  general  guidelines  for 
subsequent  inservice*    However*  even  the  few  sites  that  covered  all  the 
topics  listed  in  the  PIPs  had  to  depend  on  TRCs*  universities*  consultants* 
and  their  own  staff  to  determine  the  actual  content  and  substance  of  the 
training*    The  PIPs  also  specified  that  projact  staffs  should  develop  per- 
forman:e  objectives*    In  a  number  of  sites*  thi^  taak  occupied  most  of  the 
staff^s  in-aervice  training  time* 
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At  othar  sites  there  was  no  apparent  PIP  influence  on  the  staff  devel* 
opaient  component*    In  any  case,  it  was  difficult  to  attribute  the  existence 
of  a  staff  training  component  to  the  PIPs  because  during  the  first  year  of 
project  implementation,  Title  VII  regulations  required  that  15%  of  the 
total  project  budget  be  devoted  to  staff  development* 

Parent  and  ccmmunity  knowledge  and  attitudes*    The  PIPs  all  stressed 
the  Importance  of  communicating  with  the  parents  and  community*  Some 
called  for  community  coordinators*    Most  sites  made  an  effort  to  involve 
parents  and  to  provide  press  releases  for  local  newspapers*    In  general, 
parents  were  positive  toward  the  programs,  and  only  a  few  sites  experienced 
negative  reactions  from  either  the  parents  or  other  members  of  the  com- 
munity* 

The  influence  of  the  PIPs,  however,  was  only  moderate*    Parent  «ind 
community  liaison  is  a  fairly  standard  component  of  bilingual  programs, 
and  some  sites  hired  coordinators  even  though  they  were  not  specified  in 
their  PIPs,  ^ile  others  did  not  have  the  funds  for  coordinators  ?ven 
though  the  position  was  specified  in  their  PIPs* 

7*6*4*2   Other  resources* 

Instructional  materials*    The  intended  process  JCor  obtaining  instruc- 
tional materials  was  to  order  the  major  items  during  start*up,  then  con- 
tinue to  order  or  develop  supplementary  materials  as  needed  throughout 
the  life  of  the  program*    The  actual  process  included  heavy  use  of  exist*- 
ing  materials  in  sites  with  previous  bilingual  prograns  and,  for  all  sites, 
ordering  and  developing  of  new  materials  throughout  operation* 

Neither  ordering  nor  developing  of  materials  was  tied  closely  to  PIP 
specifications*    Most  sites  used  locally  mandated  core  texts,  and  supple** 
mented  them  as  necessary  with  new  materials*    Sites  without  previous 
bilingual-program  experience  were  more  likely  to  look  to  the  PIPs  for  sug-^ 
gestions,  but  some  of  the  PIP-specif led  materials  were  no  longer  available 
from  the  publishers  and,  therefore,  no  adopter  site  could  have  adhered 
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strictly  tt^  pip  guidelines,  even  if  the  site  had  felt  that  it  were  desir^ 
able  to  do  so*    At  least  one  site  undertook  an  ambitious  effort  to  develop 
instructional  units  for  individualizing  studeat  programs^  but  it  would  be 
inaccurste  to  sttribute  this  work  directly  to  the  pip* 

The  net  outcome  was  thst^  while  all  sites  obtained  snd  developed 
msterials  during  the  first  two  years  and,  in  most  csses^  these  materials 
were  reasonably  sdequate  for  program  needs^  these  msterials  differed  sub- 
stsntislly  from  those  used  in  the  developer  sites  st  the  time  of  vsllda*- 
tion*    The  field-teat  sites  made  the  changes  with  the  intention  of  improve 
ing  their  programs  and^  while  RMC  had  no  means  other  than  the  judgment 
of  the  site  visitors  to  evaluate  the  impact  of  the  changes^  we  have  no 
reason  to  doubt  that  they  were  successful*    However^  these  changes  repre- 
aented  another  major  breskdown  in  the  pip  diffusion  system^  since  one  of 
the  key  festures  sffecting  the  students'  dsy*-to-day  learning  experiences 
hsd  been  changed  from  thst  used  in  the  developer  site* 

Pscilities  snd  funds*    Project  fsciiities  consisted  of  conventional 
dsssrooms  in  both  the  developer  sites  and  the  field^test  sites*  Flinds 
were  not  svailsble  in  some  sites  to  cover  all  of  the  PlP^specified  stsff ^ 
snd  better  coordination  between  project  requirements  snd  funding  was 
clesrly  needed*    One  such  area  that  wss  of  psrticular  relevsnce  to  the 
RMC  study  was  the  lack  of  sdequate  funds  in  seme  sites  for  program  evsl^ 
uators*    This  problem  is  sddressed  under  the  impsct^evsluation  substudy 
but  properly  belopgs  hcre^  as  well^  since  it  wss  psrtislly  the  result  of 
lack  of  guidelines  for  the  LEAs  in  preparing  their  Title  VII  grant  appli^ 
est ions  * 

7*6*4*3   plans  snd  constrslnts!    PIP  versus  other  influences  on  program 
plans*    The  intended  program  plans,  ss  represented  by  the  Pips,  continued 
to  be  modified  throughout  the  two  years  of  the  field^test  as  the  adopter 
sites  made  sdjustments  to  fit  local  needs  snd  resources*    In  most  sites, 
the  Pips  played  a  minor  role  in  this  process*    Of  much  greater  Importsnce 
were  state  and  locsl  Isws^  regulations,  snd  guidelines*    Inputs  were  slso 
obtained  from  the  TRCs«  university  snd  other  consultsnts,  and  neighboring 
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I^As.    The  fleld-teut  sites  found  these  inputs  helpful*  but  they  repre- 
sented a  departure  frcn  the  intended  PIP  diffusion  system* 

7.6*4.4    Students*    The  major  processes  and  outcomes  of  operation 
are  those  th^t  affect  students.    In  this  section »  these  processes  and 
outcones  are  discussed  under  three  headings:    (a)  class  configurations » 
(b)  student  selection*  and  (c)  Instruction  of  students.    As  with  the 
above  sections »  the  emphasis  of  the  discussion  18  on  how  closely  the 
fleld-test-site  programs  matched  those  in  the  developer  sites  and  the 
PIPb»  and  to  what  extent  the  PIPs  influenced  those  results. 

Class  configurations.    The  PIPs  specified  that  the  projects  should 
be  installed  in  K-1  during  the  first  year  and  then  expand  vertically  one 
year  at  a  tim^*    Fifteen  of  the  19  adopter  sites  adhered  to  this  guideline* 
Three  of  the  remaining  sites  Initially  installed  the  program  in  additional 
grades  as  well*    This  decision  was  largely  the  result  of  a  prior  bilingual- 
education  project  in  the  LEA  that  encompassed  more  than  just  K-1*  One 
site  installed  a  project  at  the  K  level  only*    In  the  15  sites  that  adhered 
to  this  guideline*  the  PIP  specifications  were  probably  major  factors  in 
the  decisions* 

The  PIPs  also  specified  a  given  number  of  classrooms  per  grade  that 
should  be  installed  initially  and  in  subsequent  years*  Only  five  of  the 
19  sites  adhered  to  this  specification*  Of  the  14  sit&s  that  did  not 
conform*  two  were  slightly  larger  than  recommended  while  the  remaining 
12  were  smaller*  Of  these  12»  about  half  were  one-third  to  one-half  the 
recommended  size*  For  the  most  part»  the  size  of  the  LEA  appeared  to  be 
the  factor  that  determined  the  actual  size  of  the  project* 

Student  selection*    All  four  PIPs  recommended  procedures  for  select** 
ing  project  students*    However*  these  procedures  were  not  practicable  due 
to  local  policies  and  conditions*  Title  VTI  specifications*  and  Lau  reme- 
dies*   The  actual  procedures  for  selecting  students  did  have  long-term 
impacts  on  the  programs*    By  and  large*  the  selection  was  determined  be- 
fore the  arrival  of  the  PIPs*  first  by  the  selection  of  the  field-test 
sites  and*  subsequently*  by  the  local  selection  policies* 
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The  chdrdcterlstlcs  of  the  project  students  do,  o.^  course*  have  a 
major  dlmpdct  on  the  kinds  of  Instruction  that  are  dpproprldue  (and  on 
project  Impacts  on  achievement},  and  should  shape  the  program  substan- 
tially.   In  particular,  all  of  the  Spanlsh^Engllsh  sltea  included  Spanish- 
dominant  students  espedslly  In  grades  K  and  1.    However,  In  some  sites 
many  students  were  more  proficient  In  English  than  In  their  native  lan- 
guage.   Thus,  while  the  addition  of  the  native  language  may  have  benefited 
these  students  greatly.  It  did  not  (at  least  In  the  short  run)  penalt 
these  students  to  deal  with  more  difficult  concepts  In  their  math,  science, 
social  studies,  and  other  non-language  classes.    Excluding  Puerto  Rico, 
this  situation  existed  in  12  of  the  14  Spanlsh^Engllsh  adopter  sites. 
A  common  situation  among  these  Spanish-English  sites  was  for  students  to 
speak  some  English  and  yet  have  low  Engllsh-prof Iclency  scores  In  language 
assessment  tests.    It  was  less  common  for  students  to  be  entirely  non- 
English  speaking  (HES) .    The  project  students'  performance  on  language 
assessment  tests  Indicates  a  tendency  for  studeats  to  become  Increasingly 
more  proficient  In  English  as  they  progressed  from  K  throug^h  second  grade. 
As  can  be  seen  In  Appendix  D,  these  students  often  scored  as  well  (or 
better)  on  English-language  achievement  tests  as  they  did  on  Spanish* 
language  versions  of  the  tests. 

Instruction  of  students.    The  following  paragraphs  suimaarlse  the 

degree  of  similarity  between  the  f leld-test^slte  programs  and  the  pip 

specifications  In  the  areas  of  Instructional  objectives,  language  of  In- 
struction, and  general  Instructional  approaches. 

The  PIPs  specify  the  use  of  Instructional  ob.jectlves,    and  each  PIP 
provides  objectives  of  some  sort.    However,  the  PIPs  state  that  teachers 
are  expected  to  modify  the  objectives,  so  even  a  faithful  replication  would 
not  result  In  use  of  the  developer -site  objectives,    pip  directives  allow 
the  teachers  a  maximum  amount  of  freedom  In  making  dally  Instructional 
decisions  (as  compared,  for  example,  to  programmed  Instruction,  In  which 
teachers  make  relatively  few  decisions),  thus  making  It  unlikely  that 
adopter-site  Instruction  will  duplicate  developer-slte  Instruction  closely. 
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As  noted  tinder  start--up>  virtually  all  sites  attempted  some  review 
of  the  Instructional  objectives  In  the  PIPs  but >  In  general,  they  used 
them  as  Input  to  existing  state  or  local  objectives  rather  than  adopting 
them  as  they  stood*    By  and  large,  project  staffs  felt  that  the  PIP* 
specified  objectives  were  not  detailed  enough,  and  several  sites  felt 
their  pre-exlatlng  objectives  were  better* 

The  PIP  specifications  on  lanfguage  of  Instruction  state  that  Instruc- 
tion should  begin  in  the  students'  dominant  language  and  evolve  towards 
the  use  of  both  languages  (half  English  for  Spanish  PIPs,  two-thirds  English 
for  the  French  PIP)  by  the  end  of  first  grade*    However,  no  specific  method- 
ology Is  provided  for  second* language  Instruction,  and,  there  is  little 
Information  to  guide  teachers  In  critical  decisions  such  as  when  students 
should  begin  reading  In  the  second  language* 

Only  four  of  the  nineteen  sites  exhibited  the  exact  pattern  of  Ian* 
guage  u&e  called  for  In  the  PIPs*    In  the  others,  the  differences  were  due 
to  the  teachers'  language  skills,  the  students'  skills,  numbers  of  LESA 
students,  and  the  district's  long-range  goals*    Some  Spanish/English  sites 
provided  reading  and  content*area  Instruction  In  Spanish,  with  plans  to 
use  English  for  instruction  In  these  areas  uhen  the  students  become  more 
proficient  In  oral  English*    This  occurred  generally  at  ten  of  the  sites* 
The  other  Spanish/English  sites,  whose  students  were  more  proficient  In 
English  or  whose  Instructional  staff  were  less  prepared  to  teach  In  Spanish, 
provided  Instruction  In  both  English  and  Spanish,  In  reading  and  content 
areas,  from  the  very  beginning*    In  the  French  sites  and  In  Puerto  Rico, 
Instruction  In  French  and  English*  respectively,  was  second-slanguage  In- 
struction, since  students  did  not  come  to  school  e^^ulpped  to  learn  In 
those  languages*    However,  the  French  sites  and  Puerto  Rico  effectively 
Incorporated  second- language  Instruction  with  the  regular  study  of  con*^ 
tent  areas* 

Teaching  techniques,  content  of  Instruction,  and  Instructional  ap"- 
proaches  In  f^eneral  were  generally  conventional  in  terms  of  local  practices 
except  In  sites  where  the  use  of  two  languages  constituted  a  change*  Few 
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Bites  could  be  described  as  utilizing  highly  individualized  instruction, 
al though  most  attempted  to  do  at  least  a  conventional  type  of  grouping* 
Team  teaching  was  used  in  at  least  three  sites,  but  not  in  any  of  the 
sites  adopting  Adelante,  the  only  project  for  vhich  team  teaching  was 
deacribed  in  the  PIP  as  a  core  feature* 

7*6*5    Summary  of  Progress  and  Problems;  Operation 

Curing  the  operation  stage»  all  fleld*test  sites  established  bilin- 
gual projects,  most  of  which  reflected  the  current  state-of*the*art  in 
bilingual  education*    However »  the  PIP  diffusion  aystem  had  had  a  rela- 
tively minor  impact  on  the  specific  learning  situations  experienced  by 
the  students* 

7*6*5*1    USOE*    The  information  gained  during  operation  affected  USOE 
diffusion  plans*    jn  particular^  it  contributed  to  the  decision  not  to 
extend  the  Pip  diffusion  approach  to  additional  projects »  and  not  to  re- 
vise the  bilingual  PIPs* 

7*6*5*2   Piff users*    No  major,  relevant  impacts  on  diffusers  occurred 
during  operstion* 

7*6*5*3    Target  LEj^s*    The  field-test  sites  were  affected  in  many 
waya  during  operation »  but  only  marginally  by  the  PIPs*    The  most  obvious 
impact  of  the  PIPs  on  LEA  personnel  was  in  the  nominal  staff  configurations* 
Management  style  and  stsff  development  were  influenced  primarily  by  local 
factors*  as  were  parent/ community  components* 

Instructional  materials  reflected  the  PIP  recommendations  in  some 
field-test  sites,  but  most  sitea  adapted  the  materiala  lists  substantially 
to  suit  availability  and  local  preferences* 

Program  plans^  as  represented  by  the  PIPs*  were  also  adapted  exten- 
sively to  meet  local  needs  and  to  conform  to  local  constraints  and  re- 
sources * 
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Instruction  of  students  Included  the  use  of  two  languages  and  other 
features  common  to  bilingual  programs^  but  could  not:  be  said  to  duplicate 
the  learning  situations  from  the  developer  sltes^ 
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7*7    Summary  of  pro1ect"Mbdel  Coiaparlsons 


Section  5*3*1  described  the  four  major  types  of  project  models  used 
in  the  analyses  (i*e*»  developer-site  projects^  PIP  projects*  adopter-'Site 
initial  conditions*  and  sdopter^site  operation)  snd  listed  six  of  the 
compsrisons  among  the  models  that»  in  cQmbinstion»  provide  sn  overview 
of  the  diffusion-system  impact  (Figure  8)*    These  comparisons  have  been 
discussed  implicitly  in  the  preceding  sections  snd  are  reststed  explicitly 
below* 

7*7*1    Developer- Site  Projects  versus  PIP*Described  Projects 

The  PIPs  sccurately  reflected  the  rather  general  instructional  ap- 
proaches of  the  developer  sites  but  omitted  many  details*  some  of  which 
would  have  been  useful  to  the  field-test  sites* 

7*7*2    Developer-Site  Projects  versus  Pield-Test-Site  Initisl  Conditions 

The  developer-site  projects  obviously  represented  a  difference  from 
the  initial  conditions  in  field-test  sites  that  hsd  no  previous  bilingual 
programs*    However^  the  developer-site  projects  were  probably  not  signifi- 
cantly different  from  those  that  were  operating  in  many  of  the  experienced 
field-test  sites  prior  to  the  PIP  diffusion  effort* 

7*7*3    Developer-Site  Projects  versus  Field-Test-Site  Operations 

At  a  genersl  level*  many  similarities  run  through  Title  VII  projects* 
and  at  that  level*  the  projects  established  in  field-test-sites  could  be 
said  to  be  similar  to  the  developer-site  projects*    However*  it  would  be 
misleading  to  say  chat  the  field**test  sites  hsd  replicated  specific* 
developer-site  projects* 

7*7*4    Pip-Described  Projects  versus  Field-Test-Site  Initial  Conditions 

As  with  comparison  7*7*2>  the  PIP  projects  represented  a  difference 
from  practices  in  inexperienced  field-test  sites*  but  relatively  few  major 
differences  when  compared  to  experienced  sites* 
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7*7*5    PIP-^Deacrlbed  Projects  versus  Fleld-TeatrSlte  Operstlon 

As  with  comparison  7*7*3,  the  projects  estsbllshed  In  the  fleld-test- 
sltes  were  generslly  consistent  with  PIP  speclflcstlons,  but  It  would  be 
mlslesdlng  to  ssy  thst  they  hsd  repllcsted  the  PIP-descrlbed  projects* 

7*7*6    Tryout^Slte  Initial  Conditions  versus  Tryout-Slte  Operstlon 

The  Instsllstlon  of  the  PIP  Title  VII  Projects  represented  s  msjor 
chsnge  for  the  field-test  sites  thst  had  not  hsd  bilingual  programs  In 
the  past*    For  the  experienced  sites,  there  were  changes  In  size,  scope 
of  services,  snd  staffing  pstterns,  some  of  which  were  dlrecly  Influenced 
by  the  PIPs*    Hotmver,  chsnges  In  Instructions!  spprosches,  to  the  extent 
thst  they  occurred,  were  probably  more  often  due  to  the  avsllsblllty  of 
sddltlonal  stsff  snd  funds  thsn  to  specific  PIP  guidelines* 

7*7*7    Wlthln^Cell  Project^Model  Comparlaona 

In  addition  to  the  alx  major  comparlaona  summarized  above,  the  com- 
parlaons  within  the  four  cella  In  Figure  8  provide  Inalghta  Into  the  fac- 
tora  affecting  the  Impacts  of  the  PIP  dlffualon  ayatem*    Theae  comparlaona 
are  aummarlzed  below* 

7*7*7*1    Comparlaona  among  the  four  developer^^alte  projecta*    A  sys^ 
tematlc  comparlaon  among  the  four  developer-alte  projecta  waa  beyond  the 
acope  of  thla  atudy*    However,  the  Information  available  to  VHC  auggeata 
that,  while  no  two  of  the  projects  were  alike,  they  repreaented  four  dif- 
ferent appllcatlona  of  the  aame  basic  bilingual  approachea,  with  differ- 
^ces  reaultlng  largely  from  the  local  contexts  In  which  they  were  Imple^ 
men ted* 

7*7*7*2    Comparlaona  among  the  four  projecta  aa  deacrlbed  In  the  PIPs. 
A  detailed  analyala  of  the  almllarltlea  and  dlfferencea  among  the  four 
PIP  projects  can  be  found  In  Appendix  C*    Thla  comparison  ahows  that  while 
there  are  many  specific  dlfferencea  among  the  PIP  projects,  most  sppesr 
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to  be  arbitrary*    There  la  little  reaaon  to  chooae  one  PIP  over  another, 
and  the  optimal  aolutlon  might  be  to  combine  the  Ideaa  from  all  four 
packagea  * 

7*7*7*3    Comparlaona  among  Initial  condltlona  In  th^s  19  fleld"teat 
altea*    It  haa  been  noted  repeatedly  In  dila  report  that  the  19  field** 
teet  altea  differed  greatly  In  teraa  of  experience  and  reaourcea*  Thoae 
factora  appeared  to  be  much  more  Important  than  vere  the  PlPa  In  deter- 
mining the  ultimate  characterlatlca  of  the  programa* 

7*7*7*4    Comparlaona  among  the  19  field^teat  altea  at  the  operation 
atage*    The  ultimate  criteria  of  PlP^dlffualon^ayatem  success  are  related 
to  the  program  featurea  that  are  Implemented  In  the  adopter  altea*  In 
the  caae  of  the  blllngual^PIP  fleld-^test,  there  waa  a  wide  range  of  fea- 
turea among  the  programa  Implemented  In  the  fleld-teat  altea  and,  while 
all  programa  reflected  the  general  PIP  and  Title  VII  guidelines,  the 
similar It lea  Within  a  aet  of  altea  ualng  a  alngle  PIP  were  no  greater 
than  thoae  among  the  entire  group  of  19  fleld'>teat  altea*    That  la,  one 
could  not  Identify  which  of  the  four  FIPs  had  been  uaed  by  obaervlng  the 
featurea  of  a  field- teat**alte  program  (except,  of  course,  that  the  uae  of 
French  rather  than  Spanlah  Identified  the  Savolr  PIP}* 
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8*    DISCUSSION  AND  RECOMMENDATIONS 


8*  I    Dlacuaalon  of  Key  Dlffualon  Problems 

The  above  narrative  aummarizea  the  diffusion  proceases  and  outcomes 
broken  down  by  stages  of  diffusion*    This  section  discusses  the  problems 
in  the  diffusion  system  that  run  across  components  and  atages*    In  this 
discussion*  problems  are  organized  by: 

•  The  goals  of  the  diffusion  systems* 

•  The  projects  available  for  diffusion* 

•  The  target  audience  for  the  projects  as  represented  by  the 
field*-test  sites* 

•  The  delivery  system  for  bringing  the  projects  and  sites  together* 

•  The  incentives  for  sites  to  adopt* 

•  The  competina  influences  (working  against  replication)  from  other 
groups  or  systems* 

8*1*1    Diffuoion-System  Goals 

In  considering  the  problems  with  the  PIP  diffusion  system*  it  should 
be  reiterated  that  problems  exist  only  in  relation  to  the  goals  of  the 
system  planners  or  the  t»ther  groups  involved  in  the  system*    That  xs» 
describing  a  result  as  a  "problem^'  implies  that  something  did  not  happen 
in  the  way  someone  wanted  it  to*    The  goals  of  the  field-test  diffusion 
system  varied  among  the  persons  involved »  and  most  of  these  goals  ^fere 
never  formulated  explicitly*    In  general,  LEA  goals  were  to  obtain  funds 
and  technical  assistance  for  their  programs,  and  these  goals  were  met  to 
varying  degrees*    TAC  goals  were  to  comply  with  OBE  requirements  to  dis* 
seminate  PIPs,  and  these  goals  were  also  met* 
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In  the  case  of  USO£»  the  go&ifi»  aa  interpreted  by  BMC»  were  more 
complex^    For  the  purpoaea  of  thia  diacusaion^  USOE  goala  can  be  considered 
under  two  main  headinga: 

1*    Service  (helping  aitea  eatabliah  bilingual  programa)  including: 
a^    Reapondlng  to  LEA**expre8aed  needa  for  technical  asaiatance 
b^    Diffuaing  apecific,  exemplary  practicea 

2*    Heaearch  (determining  the  tranaportability  of  the  projecta 

and  the  extent  to  which  the  projecta  lead  to  poaitlve  outcomes 
on  students  and  othera) 

Overall)  Goala  la  and  2  were  met  to  varying  degreea»  and  the  queationa 
aa  to  how  well  they  were  met»  or  whether  they  could  have  been  met  better 
for  the  same  coat  are  purely  quantitative  onea^    Goal  lb»  however*  requirea 
accurate  replication  of  projecta  and  waa  not  met  in  the  field  teat^  In 
fact»  aa  deacribed  in  the  preceding  aection»  the  poaaibility  of  replication 
had  already  been  precluded  by  the  end  of  the  aelection/adoption  atage^ 

The  ultimate  conclusion  waa  that  the  failure  to  meet  the  diffusion 
goal  waa  due»  in  part»  to  the  fact  that  thia  goal  ia  not  appropriate 
except  under  very  limited  conditional    In  the  caae  of  bilingual  programa» 
thia  goal  would»  at  beat»  be  appropriate  only  for  the  diffuaion  of  ape- 
cific»  highly  atructured  and  relatively  simple  instructional  or  management 
practicea^    Given  the  current  state  of  the  art»  the  diffusion  of  complete* 
bilingual  (or  other)  projects  involving  a  complex  of  interrelated  instruc- 
tional »  management)  and  staff  development  ^i^^mponenta  is  unrealistic* 
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8*1*2    PIP  Projects 

The  projects  chosen  to  ma^t  the  needs  of  the  target  LEAs  presented 
major  problems  from  p.11  perspectives*    There  were  very  few  real  differences 
among  the  packaged  projects^  so  the  following  comments  apply  to  all:  (a) 
All  four  projects  depended  heavily  on  good  bilingual  teachers*    This  dras-^ 
tlcally  reduced  the  number  of  potential  adopters  for  which  the  projects 
were  suitable  (although  It  did  not  keep  sites  that  lacked  such  teachers 
from  applying  for  PIPs)*    (b)  The  projects  were  relatively  minor  varia- 
tions on  standard  themes*    Thus»  while  experienced  sites  might  have  found 
some  good  Ideas^  they  should  not  have  expected  any  major  Innovations* 
Sites  with  no  bilingual  education  experience  could  appropriately  have 
expected  basically  sound  advice^  although  coiq)arable  advice  was  widely 
available  elsewhere*    (c)  Much  of  what  was  described  In  the  PiPs  Involved 
project  managanent*    While  this  Is  a  major  factor  distinguishing  good 
projects  from  poor  ones»  many  managanent  features  are  not  readily  trans- 
portable^  since  they  require  changes  to  firmly  established  organizational 
and  administrative  structures*    (d)  Instructional  features  of  the  projects 
were  generally  not  defined  In  enough  detail  to  be  of  much  help  to  either 
experienced  or  Inexperienced  sites*     (e)  The  projects^  as  packaged^  were 
several  years  old  by  the  time  they  reached  adopters*    Materials »  and  In 
some  cases  methods^  were  often  viewed  by  adopters  as  out-of-date* 

Some  packaged  parts  of  the  projects  were  seen  as  useful  by  project 
directors  and  teachers »  but  this  depended  largely  on  the  level  of  expertise 
and  experience  of  the  personnel  rather  than  on  the  PiP  content*    The  less 
experienced  project  directors  and  teachers  used  the  time  schedules  (calen- 
dars) *  suggestions  for  In-service  topics^  performance  objectives^  and  so 
on*    Those  with  more  experience  used  the  descriptions  of  these  features  as 
checklists »  but  typically  implemented  their  own  approaches* 

In  summary^  as  part  of  a  general  attempt  to  help  LBAs»  the  projects 
provided  at  least  some  useful  Meas  for  most  of  the  field-test  sites^ 
especially  those  that  were  just  getting  started*    However^  they  address 
the  real  needs  of  only  a  limited  subset  of  Title  VII  target  LEAs*    For  a 
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goal  of  precise  replication,  the  projects  were  unsuitable*    They  required 
staff  resources  that  were  not  always  available  and  they  did  not  provide 
adequate  guidance  for  implementing  Instructional  features* 

8*1*3   Target  LEAs 

Logically,  the  place  to  begin  In  designing  any  diffusion  system  Is 
with  the  educational  needs  of  the  target-LEA  students,  and  with  the  objec- 
tives, available  resources,  snd  other  relevant  characteristics  of  the 
target  LEAs^    A  major,  additional  consideration  In  a  diffusion  system  Is 
the  a  1^2,^  of  the  target  audience  for  a  particular  set  of  projects  or  prac- 
tlces^    These  LEA^related  factors  are  discussed  below* 

8*l434l    Student  needs*    Student  characteristics  (and  consequently 
student  needs)  varied  widely  from  site  to  site  and  slso  within  each  slte^ 
Language  skills  ranged  from  extremely  limited  proficiency  up  to  native 
proficiency  In  both  languages^    Some  students  were  clearly  dominant  In 
one  language,  a  few  highly  proficient  In  both  languages,  and  still  others 
lacking  adequate  proficiency  for  acadmlc  purposes  In  either  language* 
Scores  on  standardized  reading  and  math  tests  ranged  from  well  below  to 
well  above  average^    In  general,  the  PIPs  did  not  provide  adequate  guide- 
lines for  dealing  with  this  wide  range  of  students* 

8*1*3*2    LEA  adoption  objectives*    It  Is  not  safe  to  assume  that  all 
LEAs  are  Interested  In  making  changest  and  even  those  LEAs  actively  seek'» 
Ing  change  may  not  want  to  Install  completely  new  programs*    Many  of  the 
LEAs  Involved  In  the  three  PIP  field  tests  were  more  Interested  In  refln* 
Ing  existing  Instructional  practlcest  or  providing  more  effective  manage- 
ment structures  for  loosely  organized  programs*    Many  were  also  motivated. 
In  part,  by  the  federal  funds  or  technical  aaslstance  associated  with  the 
projects  being  disseminated*    For  such  LEAs,  It  Is  Important  that  the 
available  projects  or  practices  fit  In  with  exlstlnj^  Instructional  and 
management  approaches*    Even  those  LEAs  that  wished  to  add  completely 
new  programs  (or  replace  existing  ones)  were  seldom  vllllng  to  consider 
major  changes  to  dlstrlct*-wide  practices* 
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8.1.3.3  LEA  resources.    Resources  required  for  the  adoption  of  new 
projects  may  include  personnel*  materials*  and  facilities.    Staff  skills 
and  attitudes  are  perhaps  the  most  important  LEA  resources  required  by  the 
bilingual  PIP  projects*  and  at  least  half  of  the  sites  could  not  obtain 
teachers  with  the  skills  and  attitudes  specified  in  the  PIPs.    Thus*  these 
sites  could  not  accurately  implement  either  the  PIP  projects*  or  any  other 
projects  requiring  a  f^rjll  staff  of  skilled,  bilingual  teachers.  Instead* 
these  sites  needed  projects  designed  for  the  personnel  that  were  available. 
In  the  short  run*  this  usually  meant  monolingual  Englioh-speaking  teachers 
with  bilingual  aides.    In  many  LFAs*  a  long^^tenn  program  of  staff  devel* 
opment  was  indicated. 

8.1.3.4  Other  relevant  LEA  characteristics.    Organizational  and  ad- 
ministrative structures  in  the  LEAs  were  also  key  features  from  a  diffusion 
standpoint*  and  they  proved  highly  resistant  to  chan&e.    Most  administra- 
tive procedures*  including  staff  hiring  policies  and  managetoent  of  federal 
projects*  were  applied  uniformly  within  a  given  LEA*  and  exceptions  were 
not  normally  made  for  single  projects.    This  precluded  implementation  of 
many  PIP**project  features  related  to  these  procedures. 

In  addition*  the  attitudes  of  key  administrators  are  critical 
diffusion-system  considerations*    Attitudes  toward  bilingual  education 
and  whole-project  adoption  varied  widely  in  the  bilingual-PIP  field  test. 
In  at  least  some  sites*  there  were  no  enthusiastic  PIP-project  supporters 
in  the  administrations*  and  the, PIP  project  directors  had  to  fight  an  up- 
hill battle.    The  overall  implication  is  that  new  projects  must  fit  the 
attitudes  and  existing  organizational  structures  unless  long-term  educa- 
tional and  capacity-building  components  are  included  in  the  diffusion  sys- 
tem.   A  PIP*type  diffusion  system  does  not  appear  to  be  a  feasible  mech- 
anism for  changing  these  structures  and  attitudes. 

The  community  contexts  can  be  Important  factors*  but  in  the  PIP  field 
tests  they  have  been  generally  appropriate  for  the  PIP  projects.  Often* 
principals  in  the  bilingual  PIP  sites  reported  active  interest  fi^om  the 
community*  and  some  told  of  parents  calling  to  find  out  how  to  get  their 
children  into  the  programs. 
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A  final  key  LEA  characteristic)  from  a  diffusion  perspective*  is  the 
eactent  to  which  LEAs  seek  out  information*    Among  the  LEAs  with  needs  for 
bilingual  programs*  many  of  those  that  actively  seek  out  information  al- 
ready have  programs  in  place*    LEAs  that  have  only  rudimentary  bilingual 
programs  or  none  at  all  tend  to  be  those  that  are  not  seeking  information 
about  new  programs*    Xhus»  a  much  more  aggressive  form  of  awareness  activ- 
ity is  needed  to  reach  this  Is^ortant  part  of  the  target  audience  than  was 
provided  in  the  bilingual^PIP  field  test* 

8*1*3*5    Size  of  the  target  audience*    An  additional  diffusion  prob- 
lem concerns  the  size  of  the  target  audience*  that  is*  the  number  o&  target 
LEAs  for  a  given  project  or  practice*    in  the  bilingual-PIP  field  test» 
the  audience  was  broken  into  two  groups~those  LEAs  with  French*"8peaking 
students*  and  those  with  Spanish^speaking  students*    While  the  number  of 
Spanish-speaking  students  in  the  U*S*  is  large*  it  appears  that  the  number 
of  LEAs  with  students  from  French**speaking  backgrounds  is  relatively  small* 
Thus,  while  elaborate,  PIP*type  materials  might  be  justified  for  Spanish 
projects,  the  PIPs  could  not  be  considered  cost  effective  in  the  smaller 
market  for  French  projecta*    A  target  audience  of  this  size  would  suggest 
a  quite  different  diffusion  approach,  probably  involving  less  elaborate 
materials  and  a  correspondingly  incressed  level  of  technical  assistance* 

8*1*4    Delivery  System 

The  delivery  system  that  was  intended  to  bring  the  projects  to  the 
target  LEAs  consisted  of  the  PIPs  and  related,  awareness  materials  plus  the 
TRC  and  USOE  personnel  participating  in  the  dissemination  effort*  Given 
the  set  of  projects  and  target  LEAs,  it  seems  unlikely  that  any  changes 
in  the  delivery  system  could  have  resulted  in  large  numbers  of  faithful 
replications,  but  the  study  suggests  that  several  features  of  the  system 
would  have  produced  problems  even  if  the  projects  and  target  LEAs  had  been 
highly  compatible* 

8*1*4*1    PIP  materials*    The  materials,  including  the  awareness  book- 
lets aa  well  as  the  PIP  manuals,  were  not  particularly  well  matched  to  the 
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IRC  dissemintition  activities  or  the  incentives  provided  by  the  system. 
Both  kinds  of  materials  were  patterned  after  the  original  compensatory- 
education  PIP  materials  that  were  intended  to  be  as  aelf -explanatory  as 
possible  in  a  system  that  provided  strong  incentives  to  replicate  faith- 
fully.   Xn  the  bilingual  dissemination  system,  where  technical  assistance 
was  available*  materials  might  better  have  been  designed  for  use  in  work-* 
shops  or  aa  reference  materials  to  be  used  after  completing  the  workshops. 
Under  these  conditions,  the  materials  could  have  been  simplified  and 
shortened  somewhat*  leaving  the  presenter  to  tailor  the  workshops  to  the 
needs  of  the  audience. 

With  the  lack  of  incentives  to  follow  the  PlPs  exactly,  and  the  im- 
possibility of  doing  So  in  many  cases,  much  of  the  existing  Pip  material 
was  largely  unused.    Project  directors  reported  that  they  liked  the  idea 
of  having  all  project  guidelines  conveniently  packaged,  but  some  felt  that 
the  partial  redundancy  antong  the  manuals  made  the  PlPs  inefficient  for 
them  to  use,  since  they  had  to  read  Mich  repetitious  material  in  order  to 
locate  the  information  unique  to  each  manual.    Few  project  directors 
referred  to  the  PXPs  extensively  after  the  projects  got  under  way. 

8.1. A. 2    Diffusion  personnel.    The  major  processes  carried  out  by 
the  personnel  in  the  delivery  system  were  dissemination  of  information  and, 
in  some  cases,  provision  of  technical  assistance*    In  retrospect,  there 
vere  three  required  functions  that  were  implicit  in  the  field-test  diffu- 
sion system:    (a)  promotion  of  the  adoption  concept,  (b)  assistance  in 
selecting  an  appropriate  project,  and  (c)  provision  of  staff  training  to 
LEAs*    Promotion  or  selling  of  the  PlPs  required  enthusiasm  and  credibility 
as  well  as  the  resources  and  training  to  reach  target  LEAs.    Most  of  the 
XRCs  fell  short  of  the  ideal  in  terms  of  resources  and  training,  and  some 
clearly  lacked  enthusiasm* 

Providing  assistance  in  selecting  a  project  required  an  in*^depth 
knowledge  of  the  projects  and  how  they  could  be  adapted  to  local  condi- 
tions.   Neither  the  TRCs  nor  anyone  else  in  the  diffusion  system  had  this 
knowledge,  nor  did  the  Pip  svareness  materials  contain  enough  information 
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to  substitute  adequately  for  highly- trained  disseminators.    At  least  four 
sites  reported  that  06E  or  a  TRC  had  substituted  or  attempted  to  substi-* 
tute  a  different  project  for  the  one  requested  by  the  site.    While  it 
appears  to  RMC  that  the  sites»  as  well  ss  QBE  snd  the  TItCs»  were  bssing 
theZr  selection  decisions  on  superficial  project  characteristics »  £  con*- 
siderable  amount  of  confusion  and  frustration  was  generated  by  the  substi^ 
tutions.    Provision  of  preservice  and  inservice  training  was  also  affected 
by  the  TRCs'  lack  of  specific  knowledge  of  the  PiP  projects*  although  many 
LEAs  reported  good  training  services*  reflecting  the  genersl  experience  of 
TRCs  in  bilingual  education* 

8.1.5  Incentives  to  Replicate 

Incentives  are  another  key  factor  in  the  diffusion  system.    It  is 
very  clear  from  this  and  previous  PIP  studies  that  LEAa  will  neij:her 
study  packaged  information  carefully  nor  apply  the  guidelines  faithfully 
unless  they  have  strong  incentives  to  follow  the  guidelines  to  the  letter 
(and  we  would  add»  quite  rightly  so)*    To  date»  the  only  incentive  that 
has  been  shown  to  work  is  the  provision  of  funds  contingent  on  replication. 
Given  the  characteristics  of  the  existing  projects  available  for  diffusion^ 
this  study  illustrates  that  such  incentives  are  not  warranted  and»  in  any 
case»  current  USOE  policy  precludes  this  posslblility.    Kowever»  it  is 
the  findiiig  of  this  and  other  PIP  studies  (Campeau^  Binkley,  Hawkridge, 
h  Treadway,  1978;  Stearns  1975  and  1977)  that  without  strong  incentives, 
project  directors  will  not  implement  features  that  do  not  sppeal  to  them^ 
no  matter  what  dslros  are  made  of  project  effectiveness. 

8.1.6  Competing  Influences 

The  above  discussions  have  dealt  with  the  PIP  diffusion  system  as  if 
it  operated  independeniXy  of  the  rest  of  the  world.    In  fact^  of  course, 
the  LEAs  were  influenced  by  many  other  sources^  some  of  which  were  much 
more  compelling  than  the  USOE  PIP  diffusion  effort.    Local  policies  are 
often  the  most  compelling  factors^  and  examples  of  local  policies  taking 
priority  were  common  among  the  19  field-test  sites.    A  typical  case  was 
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a  district  that  had  previously  tried  team  teaching  and  had  abandoned  it* 
PIP  specifications  calling  for  team  teaching  were  simply  ignored*  In 
general,  the  study  illustrated  that  a  single,  Title  VII  project  cannot  be 
expected  to  disrupt  established,  district  policies  or  procedures* 

Many  states  are  heavily  involved  in  developing  bilingual  education, 
and  at  least  two  SEAs  became  mjor  factors  in  obtaining  PIP  adopter  sites* 
However,  where  state  regulations  conflicted  with  PIP  specifications,  the 
state  regulations  received  higher  priority*    Specific  examples  Included 
use  of  S&A--^developed  objectives  and  S£A~re commended  materials  Instead  of 
those  r>pecified  in  the  PIPs* 

Commercial  and  professional  organizations  are  also  actively  dissemi- 
nating materials  and  teaching  techniques,  as  are  universities  and  teachers' 
colleges*    Many  of  the  adopter  sites  turned  to  these  sources  for  help,  and 
their  projects  were  influenced  at  least  as  much  by  them  as  by  the  PIPs* 
Neighboring  LEAs  also  disseminate  their  projects  and  have  many  advantages 
over  a  packaged  description  of  a  remote  project*    In  at  least  three  of  the 
19  sites,  it  would  be  accurate  to  say  that  they  had  adopted  the  project  of 
a  nearby  district  rather  than  that  of  the  PIP  developer  site* 

Finally,  Title  VII  regulations  require  all  Title  VII  sites  to  install 
most  of  the  components  of  the  PIP  projects,  and  these  regulations  cetainly 
affected  staff  development,  community  liaison,  parent  involvement,  and 
evaluation  components  in  the  adopter  sites*    While  there  were  no  major 
conflicts  between  PIP  specifications  and  Title  VII  regulations,  it  is  clear 
that,  if  conflicts  had  existed,  the  Title  VII  regulations  would  have  had 
priority  over  the  PIPs*    Considered  from  a  different  perspective,  the 
impact  of  the  PIPs,  over  and  above  that  of  the  Title  VII  regulations, 
appeared  to  be  minimal* 
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8*2    Answers  to  the  S^eclflCt  Working  Questions  from  Section  4*2 


The  general  Substudy  I  question  was»"Vhat  was  the  diffusion  effort 
on  L&As?'*    The  answer  was  that*  in  general*  the  diffusion  effort  was  not 
very  effective  In  getting  target  LEAs  to  Implement  the  major*  Identifiable 
features  of  the  developer-slte  projects*    The  specific  questions  are 
addressed  below* 

8*2*1  Adoption 

8*2*1*1    What  Influenced  potential  adopter  sites  to  adopt  or  not  to 
adopt?    The  fleld-teut  sites  were  InJrluenced  to  adopt  by  a  felt  need  to 
Install  bilingual  projects*  by  the  belief  that  a  pip  adoption  would  Improve 
their  projects  and  Increase  chances  for  funding*  and  by  the  personal 
encouragement  of  USOE  and  TRC  personnel*    Presumably*  some  target  LEAs 
chose  not  to  adopt  via  pjps  because  they  did  not  like  either  the  projects* 
the  package/replication  concepts*  or  the  fleld^test  Impositions*    Jt  seems 
likely*  however*  that  many  iDore  target  LEAs  made  no  active  decision  on 
adopting*    They  simply  never  considered  the  question  seriously  at  all* 

8*2*1*2    To  what  extent  were  the  projects  chosen  bv  the  adopters 
appropriate  to  those  adopters?    The  projects  chosen  by  adopters  were  not 
highly  appropriate  to  the  specific  adopter-site  needs  and  resources*  but* 
In  about  half  of  the  sites*  they  were  not  highly  Inappropriate  either*  By 
Inspproprlate  adoptions*  we  mean  those  where  student  needs  were  very  dlf^ 
ferent  from  those  In  the  developer  sites*  where  the  LEAs  could  not  supply 
the  required  staff*  or  where  the  sites  lacked  commitment  to  bilingual  edu-*" 
cation*    For  the  other  sites*  the  projects  were  excessively  management  orl*- 
ented  and  lacked  Instructional  detsll*  but  were  general  enough  that  they 
were  not  really  unsuitable* 

The  matching  of  projects  to  adopters*  based  largely  on  the  superficial 
feature  of  developer-slte  student  characteristics*  was  for  all  practical 
purposes  random^    That  Is*  while  several  sites  reported  choosing  a  project 
that  nominally  matched  their  student  population  (e*g**  half  limited  English 
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and  half  fluent  English),  the  PIPs  contained  very  little  Information  rele- 
vant to  dealing  with  their  particular  student  ratloa* 

8*2.2  Implementation 

8.2*2*1    What  factors  (contexts  PIP^  and  other)  Influenced  Implemen- 
tation?   Implementation  was  heavily  Influenced  by  local  conditions  and 
other  non^PIP  sources*    The  major  Impact  of  the  PIPs  was  on  staffing  pat- 
terns, (e*g*|  hiring  of  curriculum  coordinators,  community  liaison  persons, 
and  so  on)  and.  In  some  sites,  on  the  Instructional  materials*    All  In* 
stalled  some  form  of  staff  development,  parent  Involvement,  and  evaluai:lon, 
as  called  for  In  the  PIPs,  but  Title  VII  regulations  were  probably  more 
Influential  than  the  PIPs  In  these  areas* 

,8*2*2*2    What  were  the  characteristics  of  the  resulting  Programs  and 
how  cloaely  did  they  resemble  those  deacrlbed  In  the  PIPs?    The  resulting 
projecta  varied  widely  depending  on  project  director's  style,  availability 
of  staff,  and  other  local  factors*    Aside  from  ataff  qualifications »  most 
of  the  sites  resembled  all  four  of  the  rather  amorphous  PIP  projects  at 
some  level  of  detail*    However,  on  the  few  tangible^  distinguishing  fea- 
tures (e*g*,  team  teaching),  there  was  little  or  no  match  between  PIP 
projects  and  adopter-site  projects* 
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8*3    PIP  Revisions  Versus  Alternative  Substudy  I  Products 


Objective  four  of  the  blllngual-PIP  diffusion  study  called  for  revl** 
slon  of  the  PIP  materials  on  the  basis  of  user  Input  and  problems  Identic 
fled  during  the  course  of  the  study*  Funding  for  PIP  revisions  waS|  how^ 
ever,  optional  pending  the  results  of  the  first  year  of  the  study*  Given 
the  above  answers  to  the  process  evaluation  questions,  most  of  which  were 
available  by  the  end  of  the  first  year  of  the  study.  It  was  clear  that 
a  straightforward  revision  of  the  existing  materials  was  not  warranted* 

At  the  same  time,  there  was  a  general  consensus  among  BMC,  OPBE,  and 
OBE  that  there  waa  a  considerable  amount  of  Information  on  bilingual  pro^ 
Jects  and  practices  available  from  the  study,  and  that  some  of  this  Infor*^ 
matlon  could  contribute  to  federal  and/or  local  efforts  to  Improve  bilingual 
education*    The  two  basic  questions  were:    "Exactly  which  Information 
should  HMC  proceed  to  develop?"  and  '*In  what  formats  should  the  various 
types  of  Information  be  produced?"    Before  making  decisions  on  these  ques*^ 
tlons.  It  was  decided  to  seek  Inputs  from  the  potential  users  of  the  sys*^ 
tem  and  from  the  advisory  panel  for  the  study* 

8*3*1    PIP  Revision 

8*3*1*1    Inputs  from  potential  users*    On  the  fifth  of  October,  1978, 
four  members  of  the  ftMC  blllngual*^PIP  staff  met  In  Washington,  I)*C*  with 
representatives  from  OPBE,  OBE,  the  nCs,  the  MDCs,  the  BACs,  and  the 
fleld*^test  LEAs  to  discuss  the  kinds  of  blllngual*-proJ  ect  Information  that 
IIMC  should  develop  Into  user** oriented  products*    For  the  purposes  of  the 
discussion,  BMC  had  organized  the  available  Information  Into  five  cace** 
gorles: 

•  project  management  guidelines 

•  Instructional  approach  guidelines 

•  Instructional  materials  guidelines 

•  project  evaluation  guidelines 

•  grant  application  guidelines 
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In  the  discussion^  KMC  emphasi2ed  that^  while  all  are  important^  some 
were  more  appropriate  to  address  under  the  current  contract  than  others. 
In  principle,  ^'project  management"  appeared  to  be  a  particularly  appropri- 
ate area.    First,  it  is  an  area  that  seems  to  distinguish  good  projects 
from  less  effective  ones*    Second,  it  is  the  area  most  emphasized  In  the 
PIPs.    Third,  it  is  an  area  where  LEAs  are  lacking  experience,  and  fourth, 
relatively  little  information  or  help  is  available  to  LEAs  in  this  area. 

'^Instructional  approach"  is  also  an  area  in  which  LEAs  need  help,  but 
it  appeared  to  be  less  appropriate  for  inclusion  in  an  KMC  study  product. 
First,  there  is  relatively  little  specific  information  in  the  PIPs  on 
instruction,  and  what  there  is  does  not  reflect  developments  of  the  last 
five  years.    Second,  the  TRCs  and  other  agencies  provide  training  in  this 
area  and,  at  least  in  theory,  are  better  able  to  provide  the  most  current 
information,  an  important  consideration  in  a  rapidly  evolving  area  such  as 
bilingual  education. 

"Instructional  materials,"  for  use  in  the  clas  sroom  have  never  been 
included  in  PIPs,  except  for  those  materials  developed  by  the  originating 
site.    Information  about  commercial  materials  and  how  to  order  them  has 
been  included  in  all  FIFs,  but  we  now  believe  that  this  is  not  a  useful 
practice.    Materials  change  so  rapidly  that  information  about  them  must 
be  constantly  updated.    This  would  require  a  major  effort  by  a  permanent 
organization  (e.g*,  the  tfational  Clearinghouse  for  Bilingual  Education)* 

"Project  evaluation"  msy  be  the  area  in  which  the  information  avail- 
able at  both  the  federal  and  local  levels  is  most  inadequate*    In  fact, 
both  the  bilingual  program  regulations  and  most  locally  designed  evalua- 
tions are  based  largely  on  inapplicable  principles  and  inaccurate  assump- 
tions.   However,  while  it  is  possible  to  describe  the  problems  with  cur- 
rent approaches  snd  to  provide  guidelines  for  doing  the  best  evaluations 
permitted  by  the  current  state  of  the  art,  we  cannot  really  solve  the 
evaluation  problems  that  USOE  and  the  LEAs  have  experienced.    The  need  is 
for  simple,  accurate  evaluations.    The  best  that  can  be  offered  is  ^'ball- 
park"  evaluation  at  a  cost  of  considerable  effort. 
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The  final  dred»  that  of  "grant  application"  information,  is  one  of 
particular  interest  in  a  diffusion  aystem.    It  is  clear  that  in  Title  VII, 
as  well  as  in  other  programs,  grants  tend  to  go  to  LEAs  with  good  proposal- 
writing  capab:.Iities.    If  the  emphasis  of  Title  VII  is  to  continue  to  move 
toward  service  (as  opposed  to  a  demonstration  orientation),  then  one  of 
the  most  critical  diffusion  stages  is  the  selection  of  LEAs  with  p"-)ropri- 
ate  needs*    Presumably,  the  proposal  writing  process  should  I  :ned 
to  identify  such  sites  rather  than  to  serve  as  a  mmpetitiva,  e«  nation 
contest • 

In  the  October  meeting,  the  USOE  and  field  representatives  recom- 
mended that  RMC  consider  products  ;\n  the  areas  of  project  management  and 
evaluation.    They  also  emphatically  concurred  that  instruction  and  in- 
structional materials  should  be  left  to  the  appropriate  OBE  centers.  They 
were  equally  emphatic  in  their  feeling  that  the  area  of  grant  spplications 
should  be  outside  the  scope  of  RMC  concerns. 

8.3*1.2  Advisory  Panel  recommendations.  On  the  second  and  third  of 
November,  1978,  the  HMC  advisory  panel,  composed  of  experts  in  the  fields 
of  bilingual  education,  dissemination,  and  evaluation,  met  in  San  Jose  to 
review  the  findings  of  the  first  year  of  the  Bilingual  PIP  evaluation.  RMC 
recommendations  for  PIP  revisions  and  potential  study  products  were  among 
the  topics  discussed.    (See  Appendix  B*) 

From  the  beginning,  the  panel  adopted  a  broad  perspective  on  the 
needs  of  bilingual  educators  for  packaged  materials.    In  Tjarticular,  rather 
than  focusing  narrowly  on  the  question  of  what  might  be  done  to  improve 
the  existing  PIPs,  they  ask  the  more  general  question  of  what  kinds  of 
materials  would  be  mosL  useful  in  establishing  bilingual  programs.  While 
this  approach  was  of  their  own  choosing,  it  was  entirely  consistent  with 
the  position  that  RMC  has  taken  in  this  report.    That  is,  diffusion-system 
requirements  should  determine  the  kinds  of  materials  to  be  developed,  not 
vice  versa < 

The  panel  made  many  useful  suggt-stions ,  and  focused  on  three  issues 
of  special  interest.    First,  the  so-called  "super-PIP"  format  was  popular. 
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This  type  of  package  would  provide  Information  pooled  from  many  exemplary 
projects  In  contrast  to  the  existing  PIPs  which  consist  of  a  distinct  pack- 
age for  each  project.    Secona,  It  was  suggested  that  the  package  should 
not  be  language  specific,  that  Is,  that  It  should  ;>resent  sound  principles 
of  bilingual  education  that  could  be  applied  to  many  different  language 
groups.    Third,  the  panel  encouraged  the  development  of  additional,  high 
quality  materials  In  the  area  of  Instructional  approaches  and  techniques. 
They  also  supported  the  development  of  practicable  evaluation  quldellnes. 

The  KMC  staff  concurred  with  the  position  of  the  panel  and  felt  that, 
in  terms  of  KMC  study  constraints,  the  implications  were  clear.    The  panel 
was  Faying,  in  effect,  that  a  revision  of  the  existing  PIPs  would  not  be 
sufficient  to  bring  the  packages  into  line  with  real  needs.    However,  JDRP 
policies  and  BMC  contract  limitations  precluded  the  development  of  new 
guidelines  for  bilingual  programs.    Thus^  most  of  the  kinds  of  materials 
that  would  be  needed  to  meet  the  needs  would  be  outside  of  the  scope  of 
this  study. 

8.3.1.3    Conclusions  concerning  PIP  revisions.    Based  on  the  exper-* 
lence  of  this  study,  the  experience  gained  from  other  PIP  studies,  and 
the  insights  gained  from  the  two  meetings  discussed  above,  the  following 
conclusions  were  reached  concerning  PIP  revisions: 

a.  No  dramatic  solutions  to  the  problems  of  establishing  bilingual 
programs  would  be  available  either  from  the  existing  PIPs  or 
from  the  fleld^test  sites.    Therefore,  revised  PIPs  based  on 
these  sources  of  Informalon  would  be  of  limited  value.  VDiile 
the  study  has  suggested  some  directions  that  could  be  taken  in 
developing  project  implementation  materials,  the  actual  develop- 
ment would  be  outside  of  the  scope  of  the  study. 

b.  There  are  no  existing  diffusion  systems  capable  of  diffusing 
Intact,  bilingual  pr  *^cts.    Furthermore,  given  the  nature  of 
the  available  blllnt'-^  projects,  development  of  such  a  system 
is  probably  unwarranted  and  may  be  impossible. 
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To  elaborate*  ve  have  found  that  there  are  few  real  differences  among 
the  four  bilingual  PIPs  and  that  the  total  amount  of  practical  information 
in  the  PIP  manuals  is  rather  limited.    In  particular,  we  concluded  that 
the  amount  of  information  in  the  PIPs  did  not  Justify  the  development  of 
a  polished  management  manual.    From  the  perspective  elaborated  in  this  re- 
port »  any  such  materials  should  be  conceived  and  developed  only  within  the 
context  of  a  well-thought-out  diffusion  system*  and  the  justification  for 
developing  such  a  system  should  be  to  get  effective  projects  and  practices 
to  LEAs  that  need  them.    In  the  case  of  the  management  guidelines »  no  such 
system  exists »  nor  do  the  projects  as  described  in  the  PIPs  justify  the 
development  of  a  system.    Given  that  a  manual  based  solely  on  information 
extracted  from  the  PIPs  (or  from  the  PIPs  plus  the  field**test  experience) 
would  contain  little  that  was  not  widely  available  elsewhere^  and  that 
there  is  currently  no  specific  demand  for  the  manual,  the  effort  of  produc- 
tion was  judged  not  to  be  warranted. 

8.3.2    Alternative^  Substudy  I  Products 

8.3.2.1  A  comparative  analysis  of  the  four  bilingual^PIP  projects. 

In  lieu  of  a  revised  management  manual^  a  detailed  analysis  of  PIP  contents 
was  prepared  for  this  report  (Appendix  C).    The  purpose  of  this  analysis 
is  to  ensure  that  the  content  of  the  PIPs  is  readily  available  for  the  use 
or  information  of  any  interested  persons >  and  to  document  the  problems 
with  the  PIP  projects  in  the  most  efficient  manner.    The  appendix  describes 
the  contents  of  the  four  PIPs  in  terms  of  a  bilingual*^roject  framework 
that  highlights  not  only  the  similarities  and  differences  among  the  four 
projects,  but  also  the  potentially  important  topics  that  are  not  addressed 
in  any  of  the  packages. 

8.3.2.2  A  framework  for  planning  or  analyzing  a  diffusion  system. 

A  second  major  product  of  the  diffusion  substudy  is  the  approach  to  devel** 
oping  frameworks  or  "models"  of  diffusion  systems.    The  approach  is  specif*^ 
ically  intended  for  systems  designed  and  operated  by  agencies  such  as  (JSOL 
or  SEAs  for  large  scale  diffusion  of  projects  or  practices.    The  frame- 
works; 
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#  Integrate  the  goals*  projects^  target  LEAs>  delivery  system. 
Incentives*  and  effects  of  competition* 

#  Include  the  processes  of  Information  transfer »  decision  making » 
and  resource  allocation* 

#  Focus  on  actions  that  the  syatem  operators  (e*g^,  USOE)  can 
take  to  achieve  system  goals »  such  as  selecting  and  training 
dlffualon  personnel)  developing  guidelines  and  materials »  and 
allocating  resources* 

This  approach  was  Initially  developed  by  BMC  for  Studies  2  and  6»  and  was 
extensively  revlaed  In  the  bilingual  PlP  study*    It  Is  described  In  Ap' 
pendlx  E  of  this  report* 
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8.4    Synopsis  of  Recommendations  from  SubstudV  I 
8*4.1    General  Recommendations  for  Future  Dlffualon  Efforts 


The  major  conclusion  to  be  drawn  from  the  PIP  field  tests  Is  that  a 
successful  diffusion  effort  would  require  careful*  systematic  Planning. 
This  planning  must  Include: 


•  Establishing  specific*  practicable  gosls. 

•  Selecting  (or  developing)  and  validating  appropriate  practices. 

•  Analyzing  target  LEA  needs. 

•  Developing  a  delivery  aystemt  with  an  appropriate  balance  of 
coordinated  technical  assistance  and  packaging. 

•  Providing  Incentives*  If  needed. 

•  Considering  the  competition t  and  adapting  the  diffusion  system 
as  necessary. 


Furthermore*  the  PIP  concepts  are  not  suitable  for  the  diffusion  of 
complete^  blllnRual  prolecta  or  other  projects  of  comparable  complexity. 
Specifically: 


The  PIP  Concepts: 
Stand-alone  packaging 

Rapid  start-up 

Whole-project  adoption 


Should  be  replaced  bv: 

Complementary  packaging 
and  technical  assistance 

Long-term  program  and 
staff  development 

Tailoring  o£  practices  to 
local  needs 


The  PIP  concept  may  be  appropriate  for  the  diffusion  of  some  structured* 
relatively  self-contained  projects  or  components  of  projects. 


8.4.2    Goal-SPeclf Ic  Rf^^f^wmf'ndations 


Detailed  diffusion-system  recommendations  depend  on  the  goals  that 
are  set  for  the  system.    In  particular*  a  system  intended  to  promote  the 
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diffusion  of  specific,  validated  projects  or  practices  with  little  or  no 
adaptation  (e.g.,  the  PIP  diffusion  system)  will  be  very  difficult  to  es- 
tablish, and  In  such  a  system,  each  of  the  six  elements  listed  above  repre- 
sents a  major  problem  area.    By  contrast,  a  system  that  will  simply  provide 
target  LEAs  with  access  to  new  Ideas  and  to  technical  assistance  and  which 
permits  extensive  adaptation  Is  relatively  easy  to  establish.    Of  course, 
the  two  kinds  of  goals  need  not  be  treated  as  alternatives  since,  at  least 
In  principle,  both  could  be  pursued  together. 

8.4.2.1    Diffusion  of  specific,  validated  Practices.    If  a  goal  simi- 
lar to  that  of  the  PIP  diffusion  system  were  retained,  that  is,  to  promote 
accurate  replication  of  specific,  carefully  developed  and  validated  prac- 
tlces,*  then  the  current  study  indicates  that  only  a  very  carefully  planned 
and  developed  diffusion  system  could  have  any  chance  of  meeting  the  goal. 
System  development  would  have  to  Include,  at  a  minimum: 

•  Development  and  validation  of  effective  practices  that  would  meet 
the  different  LEA  needs  and  would  recognize  the  variations  among 
LSAs  in  availability  of  resources,  management  preferences,  stu^ 
dent  needs,  and  so  on.    We  see  the  lack  of  dramatically  effective 
practices  as  the  key  weakness  in  any  such  diffusion  effort. 

•  Analysis  of  tarjtet  LEA  needs,  resources,  and  Informatlon^seeklng 
characteristics. 

•  Development  or  identification  of  «  delivery  system  that  could 
provide  awareness  among  LEAs,  elicit  their  commitment i  and  pro-- 
vide  them  with  technical  support  to  Implement  the  practices. 

•  Incorporation  of  incentives  to  ensure  that  adopters  Installed 
the  practices  and  gave  them  a  reasonable  trial; 


^e  assume  that  the  concept  of  whole-^project  adoption  would  be 
abandoned . 
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•     Coordination  with  federal^  state^  locals  and  professional 
Systems  to  eliminate  sources  of  conflict. 

In  addition >  if  the  goal  Included  the  lonR-term  maintenance  oi  the  projects 
In  adopter  sltes^  a  permanent  monitoring  and  technical  assistance  system 
would  have  to  be  developed  and  Installed. 

It  is  our  understanding  that  the  kind  of  system  described  above  is 
not  consistent  with  current  USOE  diffusion  policies  and>  given  the  char- 
acteristics of  existing  practices »  we  believe  that  such  a  system  would  not 
be  justified.    Therefore^  Section  8.4.2.2  suggests  a  more  realistic  set 
of  recommendations  that  would  follow  from  a  diffusion  goal  of  disseminat- 
ing Ideas  rather  than  diffusing  specific  practices. 

8.4.2.2    Dissemination  of  Ideas.    If  a  goal  that  was  less  stringent 
In  terms  of  replication  were  substituted  for  the  diffusion  of  practices 
(e.g.>  to  provide  LEAs  with  access  to  information  on  the  most  successful 
bilingual  project;?  and  practices  and  to  facilitate  the  adoption  of  any 
combination  of  such  practices  in  LEAs  that  requested  assistance) >  the 
diffusion*  System  would  still  require  major  changes  for  optimal  effective^- 
ness»  but  the  system  might  be  somewhat  less  difficult  to  develop. 

Target  LEAs  would  still  need  to  be  analyzed  to  determine  their  needs 
and  resources  and  to  determine  how  large  the  market  is  for  a  given  kind  of 
Information.    Existing  projects  and  practices  would  need  to  be  analyzed  to 
determine  the  ways  In  which  they  differ^  the  needs  they  address^  and  the 
resources  they  require »  so  that  this  Information  could  be  provided  to 
target  LEAs. 

Delivery  systems  could  then  be  tailored  to  the  size  of  the  markets  and 
the  characteristics  of  the  practices  and  target  LEAs.    Promotion^  matching 
practices  to  sltes^  and  technical  assistance  would  still  be  required  but 


*Strlctly  speakings  this  would  be  a  dissemination  system  rather  than 
a  diffusion  system. 
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would  vary  widely  depending  upon  the  above  factors*    The  design  of  packaging » 
or  of  materials  ±t>  general*  should  be  considered  only  within  the  context  of 
specific  dissemination  plans*    Development  of  elaborate  dissemination  mate** 
rials  would  be  undertaken  only  where  large  audiences  were  involved  or  long 
shelf  lives  for  the  materials  were  anticipated* 

External  Incentives  would  play  a  minor  role  In  such  a  system*  since 
the  emphasis  would  be  on  responding  to  LEA  requests*    Coordination  with 
other  agencies  would  remain  an  important  consideration  so  that  conflicts 
and  redundancy  could  be  minimized* 
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SUBSTUDY  II:    IMPACT  ON  STUDENTS 


9*    INTRODUCTION  TO  SUBSTUDY  II:    IMPACT  ON  STUDENTS 


9*1    Scope  of  Subfltudy  II 

9*1*1    Subfltudy  II  Objectives 

The  flecond  objective  In  the  RFP  for  the  blllngual*PIP  fleld-teflt 
fltudy  wafl  to  "determine  the  ef f ectlveneflfl  of  projectfl  implemented  via  the 
PIPfl  In  Improving  fltudent  achievement  and  attitude*'  (Section  4*1}*  Sub- 
fltudy II »  the  impact  flubfltudy»  wafl  conducted  In  reflponfle  to  thlfl  objec* 
tlve*    Section  12  Includefl  a  dlflcuflfllon  of  Impactfl  on  attltudefl*  Sectlonfl 
9-11  are  concerned  with  the  evaluation  of  Impactfl  on  achievement* 

It  flhould  be  kept  In  mlnd»  however*  that  the  primary  focufl  of  the 
entire*  cwo*^year»  blllngual-PIP  fltudy  wafl  the  proceflfl  evaluation  (Subfltudy 
I}*      The  Impact  flubfltudy  received  flecondary  emphafllfl  becaufle  it  wafl  not 
certain  in  advance  that  the  dlffufllon  flyfltem  would  produce  the  intended 
renult  of  complete  replication  in  the  target  LEAfl  (and»  in  fact»  it  did 
not)*    Becaufle  of  thlfl  uncertainty »  it  wafl  not  clear  how  much  effort 
flhould  be  Inveflted  in  fltudent  outcome  evaluation*    FUrthermore»  becaufle 
the  ctudy  paralleled  the  flrflt  two  yearfl  of  a  five-year  Implementation 
plan»  data  could  only  be  collected  from  gradefl  K-2  of  projectfl  that  would 
eventually  expand  to  fourth  grade*    Therefore,  the  fltudy  could  not  provide 
fltudent  outcome  resultfl  from  completely  implemented,  fully  operational 
programfl  * 

On  the  other  hand  if  USO£  had  waited  two  yearfl  {or  the  dlffufllon  re- 
flultfl  before  conflldering  an  outcome  evaluation,  much  of  the  data  needed 
for  a  longitudinal  Impact  aflfleflflment  might  never  have  been  collected* 
Thufl,  it  waa  reaflonable  to  include  a  limited  form  of  Impact  evaluation 
in  the  billngual-PIP  fleld-teflt  fltudy* 

The  Important  point  to  mphaflize  la  that,  in  thlfl  atudy,  the  attempt 
to  evaluate  project  Impact  wafl  independent  of  how  well  the  projectfl,  afl 
deflcrlbed  in  the  PIPfl,  had  been  Implemented*    The  attempt  wafl  to  evaluate 
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each  project  as  it  was  operating*    Interpretation  of  project  impact^  of 
course^  must  depend  on  the  features  of  the  project  that  are  in  place;  but» 
because  the  two  questions  had  to  be  addressed  concurrently^  the  study  ap- 
proach was  to  develop  the  best  possible  outcome  evaluation  for  each  site> 
Whether  or  not  the  PIPs  had  been  effective  in  producing  faithful  adoptions, 

9*1*2    Specific  Impact^Substudy  Questions 

The  impact  evaluation  was  intended  to  measure  improvements  in  student 
achievement  resulting  from  the  diffusion  effort**  Of  course^  Subatudy  I> 
Which  provided  the  information  as  to  the  kinds  of  changes  in  field-test- 
site  programs^  was  the  key  to  interpreting  the  impact  results  and  attri-* 
buting  any  gains  to  program  changes*  The  purpose  of  the  impact  substudy 
was  to  determine  how  much^  if  at  all»  student  performance  improved  after 
implementation  of  the  PIP-projects* 

Four  major  subject  areas  were  included  in  the  impact  substudy: 

•  English  reading 

•  Spanish  or  French  reading 

•  English  language  proficiency 

•  Math 

Many  of  the  field-test  sites  included  additional  subject  areas  in  the4r 
local  evaluations^  and  these  areas  were  examined  by  RMC*    In  particular^ 
data  on  Spanish  or  French  language  proficiency  were  examined  where  avail- 
able and  are  included  In  Appendix  D*    However^  the  four  areas  listed  above 
represented  a  common  core  in  most  of  the  sites  and  thus  received  most  of 
the  attention  in  the  RMC  study* 

Initially^  it  was  RMC's  intention  to  answer  the  impact  substudy 
questions  through  careful  application  of  state-'of '^the-'art  evaluation 


Effective  outcomes  are  discussed  in  Section  12*    Section  12  also 
includes  brief  discussions  of  evaluations  of  staff  development  and  parent/ 
community  components. 
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methodology.    As  the  study  progressed,  It  became  Increasingly  clear  that 
the  state-of-the-art  was  Inadequate  to  provide  the  desired  answers,  and 
RMC's  liDpact-substudy  emphasis  shifted  toward  methodological  Issues  (see 
Section  10:    Technical  Issues).    By  the  end  of  the  study,  the  major  Impact 
questions  had  become: 

•  in  general,  how  If  at  all.  Is  It  possible  to  determine  the 
Impact  of  new  educational  programs  In  real-school  settings? 

•  Specifically,  are  there  credible  Impact  results  (either  positive 
or  negative)  from  any  of  the  field-test  sites? 

These  questions  are  addressed  below. 
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9.2    The  RMC  Role  In  the  Im&act  Substudy 


Unlike  Substudy  I,  in  which  RMC's  role  was  that  of  a  non-reactive 
observer*  RMC  was  Intended  to  pl^y  ^n  active  role  In  the  Impact  evalua~ 
tlons.    Specifically^  RMC  was  to  utilise  the  evaluations  being  conducted 
Independently  by  each  of  the  field-test  sites  under  the  conditions  of  the 
Title  Vll  regulations »  and  to  summarise  or  reanalyze  the  results  of  these 
studies  as  necessary  for  the  purposes  of  the  PIP  study.    Further*  RMC  was 
to  meet  with  the  local  evaluators  at  the  beginning  of  the  field-test  to 
assist  the  evaluators  In  designing  enough  similarity  into  their  various 
evaluations  to  permit  some  summarising  of  results  across  sites,    it  was 
also  Intended  that  RMC  should  provide  consulting  help  as  required  to  in- 
sure the  quality  of  all  evaluations. 

RMC  was  not  expected  to  collect  data»  to  perform  the  original  analy- 
ses On  the  data»  or  to  participate  in  the  preparation  of  f leld-^t^st-slte 
Title  Vll  evaluation  reports.    In  all  Interactions »  RMC's  role  was  that 
of  a  consultant*  and  all  evaluation  decisions  were  ultimately  in  the  hands 
of  the  Individual  LEAs. 
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9*3   Organization  of  the  Substudv  II  Report 


The  remaining  sections  of  this  report  describe  the  technical  Issues » 
the  Impact  substudy  activities^  and  the  results  of  these  activities*  Sec* 
tlon  10  discusses  both  the  theoretical  Issues  Involved  In  conducting  Im^ 
pact  evaluations  and  the  practical  probleics  encountered  In  the  fleld*test 
sites*    Section  11  describes  the  first  year  of  the  substudy^  which  was 
devoted  prlmerlly  to  the  development  of  the  local  evaluation  designs* 
Section  It  also  describes  the  second  year  of  the  study  which  began  with 
attempts  to  Interpret  local  evaluation  results^  and  ended' with  the  devel* 
opment  and  application  of  procedures  to  rate  the  credibility  of  Impact 
results  from  ^^ach  site*    Section  12  summarizes  the  Issues  related  to  eval* 
uatlons  of  student  attitudes^  staff  development  activities^  and  parent/ 
community  Involvetnent  components*    Section  13  summarizes  the  conclusions 
and  recommendations  from  the  Impact  substudy* 


10.    TECHNICAL  ISSUES  IN  THE  EVALUATION  OP  STUDENT  ACHIEVEMENT  IMPACTS 


10 . 1    "Impact"  Versus  "Performance  Level"  Evaluation 

This  report  refers  repeatedly  to  the  Impact  on  achievement  of  a  dif- 
fusion system,  a  program*  or  a  project.    By  this  we  mean  the  change  (hope- 
fully improvenkent)  in  performance  produced  by  new  practices.    The  Impact 

question  is  emphasized  here  because  this  was  a  diffusion  study»  and  the 
Justification  for  apendXng  time  and  money  on  diffusion  derives  from  the 
change  that  results.    Impact  on  achievemr.nt  is  not  Che  only  Impact  of  in- 
terest* but  it  is  a  apeclal  concern  of  many  educators  and  diffusion  per- 
sonnel. 

Impact  on  achievement  may  also  be  of  Interest  to  the  LEA»  because 
most  LEA  decision  makers  would  like  to  know  vhether  changes  in  practices 
are  followed  by  improved  performance.    However»  the  more  Important  achieve- 
ment, conalderation  from  the  ^A  point  of  view  may  be  the  performance  level 
of  the  students.    '^Performance  level"  refers  here  to  how  well  or  poorly 
students  are  achieving  in  relation  to  other  groups  of  students  or  in  terns 
of  requirements  for  Jobs  and  personal  satisfaction.    An  LEA  may  not  be 
satisfied  with  a  large  Impact  if  performaiice  level  is  still  low.  Con- 
versely»  the  LEA  may  be  entirely  satisfied  with  a  small  positive  Impact 
if  performance  levels  were  already  high. 

Prom  the  standpoint  of  the  dif fuaion-system  planner*  however*  impact 
is  the  primary  consi'ieration.    High  performance  levels  are  no  indication 
of  diffusion-system  success*  since  they  do  not  necessarily  prove  that  thare 
has  been  improvement  due  to  the  diffusion  effort^    Conversely*  low  perfor- 
mance levels  do  not  necessarily  imply  diffusion-system  failure*  since  they 
may  represent  Improvement  over  still  lower  levels  of  performance.  (The 
distinction  between  i!^tv*\-.nt  performance  level  and  dif fusion-systezo  impact 
is  illustrated  in  Figure  3*  Section  3.1.3.) 

Thus*  to  tae  extent  that  student  achievement  outcomes  are  addressed 
in  this  diffusion  study*  the  emphasis  is  on  the  impact  produced  by  the 
bilingual-PIP  diffusion  system.    Performance  level  is  also  discussed*  but 
h^s  only  indirect  relevance  to  the  study. 
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10.2    "Apparent"  Versus  "Actual"  Impacts  of  Exemplary  Programs 

One  might  naively  assume  that  positive  achievement  Impacts  would 
result  from  the  successful  diffusion  of  exemplary  projects  (l.e.»  In  the 
PIP  studies*  from  the  diffusion  of  projects  having  apparently  positive 
Impacts  In  the  developer  sites).    Of  course*  as  noted  In  Section  1.1.1.3, 
a  single  project  In  two  different  contexts  leads  to  two  different  programst 
and  the  fact  that  the  original  program  was  effective  does  not  necessarily 
Imply  that  the  adopter-^slte  program  should  be  effective.    However*  an  ^d-^ 
dltlonal  factor — the  evaluation  (and*  In  particular*  the  variation  or  error 
In  evaluation  procedures) — is  involved  In  the  apparent  Impact  of  a  project 
on  achievement.    That  Is*  the  apparent  Im'^act  is  a  function  of  the  project* 
the  context*  and  the  evaluation  (see  Fig'      4*  Section  3.1.3). 

In  a  diffusion  impact  study*  problems  arise  because  the  measurement 
of  program  Impact  in  the  real  world  Is  very  Inexact.    First*  because  of 
evaluation  error*  two  different  evaluations  of  the  identical  program  may 
produce  very  different  results.    Further*  the  amount  of  error  In  most 
program  evaluations  (bilingual  or  other)  Is  large  In  comparison  to  typical 
program  Impacts  on  student  scores  (up  to  several  times  as  large)*  Finally* 
thf^  step  of  separating  project  Impacts  from  context  Impacts  is  next  to 
Impossible  *      iny  LEAs. 

The  net  result  is  that  even  th^  most  faithful  replication  of  an 
exemplary  projeci;  In  a  n^»w  site  Is  not  likely  to  reproduce  the  original 
programt  and  even  If  the  programs  were  Identical*  differences  (errors)  In 
the  evaluations  of  the  originating  and  replicating  sites  would  make  It 
unlikely  that  the  apparent  Impact  of  the  project  would  be  the  same  In  the 
originating  and  replicating  sites.    The  actual  Impact  of  a  project  is  an 
elusl^'e  concept  and»  In  practice »  Is  very  difficult  to  determine  under 
field  test  conditions. 
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10*3    Clarification  of  the  Impact-Evaluation  Questions 


The  basic  Substudy  II  question  was — What  were  the  Impacts  on  student 
achievement  of  the  bilingual  projects  In  the  field-test  sites?    As  we  shall 
explain  In  Section  12*  the  answer*  after  two  years  of  evaluation*  Is  that 
no  one  can  be  sure*    In  some  part*  the  lack  of  Information  Is  due  tn  defi- 
ciencies In  the  f leld-test-slte  evaluation  reports  discussed  In  Section  12* 
but  the  fundamental  problems  lie  In  the  evaluations  themselves*  and  In  the 
current  state^^of-the-art  In  evaluation  methodology* 

The  major  problems  are  discussed  later  In  this  section*  but  before 
considering  them  Individually*  It  Is  essential  to  make  some  Important  dis- 
tinctions among  the  different  kinds  of  outcome  valuation  questions  that 
may  be  asked  and  among  the  respective  problems  Inherent  In  answering  the 
questions*    As  will  be  seen*  the  question  of  ^'program  Impact"  Is  the  most 
Interesting  question  from  the  perspective  of  this  study*  but  also  the  most 
difficult  to  answer*    Other  questions  that  are  easier  to  answer  may  also 
be  of  Interest  but*  unfortunately*  there  Is  usually  a  direct  relationship 
between  level  of  Interest  and  difficulty  In  obtaining  answers* 

The  definition  of  evaluation  questions  Is  an  extremely  complex  sub- 
ject* and  can  be  approached  from  many  perspectives*    At  the  risk  of  over- 
simplifying* this  discussion  divides  the  Impact  questions  Into  (a)  those 
concerning  the  skill  (or  knowledge)  areas  In  which  student  performance  Is 
to  be  measured*  and  (b)  those  related  to  the  standards  against  which  per- 
formance Is  to  be  compared* 

10*3*1    Defining  the  Skill  Areas  of  Interest 

10*3*1*1    Measuring  appropriate  skill  areas  In  program  evaluations- 
A  major  goal  of  most  bilingual  programs  Is  to  improve  student  performance* 
It  Is  not  really  meaningful*  however*  to  speak  of  performance  In  general, 
and  the  evaluator  must  first  determine  which  skill  areas  are  of  Interest* 
That  Is*  the  evaluator  must  ask  which  general  subject  areas  to  evaluate 
(e*g*^  reading*  math*  language*  and  so  on}*  and*  for  each  area,  whether 
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only  specific  topics  are  of  Interest  (e.g.>  decoding^  computation^  local 
ecology)*    Although  It  Is  seldom  done»  the  evaluator  should  also  ask 
whether  students  gain  Iti  one  area  at  the  expense  of  another  (e.g.»  does 
reading  itoprove  at  the  expanse  of  math?). 

The  evaluator  must  next  consider  whether  the  tests  used  In  the  eval- 
uation provide  valid  measures  of  the  skill  areas  of  interest.    The  answer 
will  depend  to  some  extent  on  the  Interaction  between  the  tes;:  and  the 
program.    That  ls»  a  test  of  general  reading  skills  may  be  relatively 
Insensitive  to  the  impact  of  a  program  that  focuses  on  a  few>  specific^ 
, omponent  skills.    On  the  other  hand>  a  test  that  Is  tailored  to  the 
program  curriculum  may  give  an  unrealistic  picture  of  general  reading 
Improvement.    How  closely  the  test  should  match  the  curriculum  Is  an  un- 
resolved dilemma  In  educational  evaluation^  but  the  effects  of  the  natch 
on  performance  measures  are  not  difficult  to  understand  and  should  be 
addressed  whei.  Interpreting  any  evaluation  results. 

10.3. 1.2    Limitations  on  skill  area£  measured  In  the  blllngual"PIP 
study.    The  basic  question  that  this  study  was  designed  to  answer  Is — Did 
the  PlPs  1 elp  the  adopter-sites?    As  discussed  In  Parts  A  and  B  of  this 
volume^  tie  answer  Is  complex  since  changes  In  processes  as  well  as  In 
student  pi  rf ormance  may  constitute  Improvements.    We  have  also  pol-^ted 
out  that  the  student  performance  questions  must  be  separated  from  the 
Implementation  questions,  so  that  In  this  part  of  the  report  we  are  asking 
only  about  the  impact  of  the  programs  as  they  exist.    Only  after  obtaining 
clear  answers  to  these  Impact  questions  would  we  have  been  able  to  proceed 
to  drawing  conclusions  about  the  relation  of  program  fand  contextual)  fea- 
tures to  Impacts.    Consequently »  the  student  outcome  evaluation  was  focused 
on  oxiBf  restricted  question;    "Did  PIP-program  students  learn  more  than 
comparable  district  students  were  learning  before  the  implementation  of 
the  program?** 

Considering  this  question  from  the  perspective  of  the  skill-area  dis- 
cusslon^  above^  It  Is  easy  to  see  that  considerable  uncertainty  must  remain 
In  an^  but  the  most  elaborate  of  evaluations.    In  the  blllngual-PIP  study> 
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performance  measures  consisted  of  a  limited  number  of  tests»  and  the  skill 
areas  that  were  measured  may  not  have  been  precisely  appropriate  to  the 
questions  being  asked*    Further*  no  systematic  attempt  was  made  by  RMC  to 
determine  the  impacts  of  the  programs  in  subject  areas  outside  of  reading* 
language*  and  math*    Therefore*  strictly  speaking*  the  study  question  be- 
came restricted  to— Did  program  students  learn  more  in  the  specific  skill 
areas  reflected  in  the  tests? 

10*3*2    Obtaining  Comparison  Standards 

10*3*2*1  Commonly  used  standards  of  comparison*  Given  this  specifi- 
cation of  the  skill  and  knowledge  areas  being  addressed  in  the  bilingual^ 
PIP  study*  it  is  then  possible  to  consider  whether  students  performed 
better  in  these  areas  than  some  relevant  standard*  and*  if  so*  whether  the 
impiTOveiDent  was  due  to  the  bilingual  program*  Four  commonly  used  compari- 
son standards  are  listed  below*  with  indications  of  the  questions  to  which 
they  are  relevant*  and  of  the  significance  of  those  questions* 

•  Posttest  compared  to  pretest*    This  widely-used  comparison 
answers  the  question — Did  students  learn  anything  while  in  the 
program?    In  general*  this  question  is  of  no  interest*  since 
most  students  show  pretest-to-'posttest  gains  in  any  program* 
By  itself*  this  comparison  provides  no  infonnation  without  one 
of  the  following  about  either  the  size  of  gains  or  the  role  of 
the  bilingual  program  in  producing  the  gains* 

•  National  norms*    This  is  the  comparison  standard  used  in  the 
vast  majority  of  educational  evaluations**    It  answers  the  ques- 
tion— Did  students  learn  more  in  the  measured      '11  areas  than 
the  nationwide  average  for  students  who  obtained  the  same 


*The  use  of  grade-equivalent  scores  is  a  special  case  of  using  na- 
tional norms  as  a  comparison  standard*    However*  while  national  noma 
often  provide  a  useful  comparison^  percentiles  or  standard  scored  should 
always  be  used*    Graae  equivalent  scores  are  not  suitable  for  any  evalu- 
ation purposes  (see  Volume  III). 
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pretest  scores  (e*g*,  if  program  students  scored  at  the  thirtieth 
percentile  on  the  pretest,  did  they  learn  more  than  the  average 
of  thirtieth  percentile  students  in  the  country)?    This  compari- 
son tells  us  whether  the  gain  was  large  or  small  by  national 
standards,  but  not  whether  it  was  larger  than  similar  students 
In  the  field-test  site  achieved  before  the  PIP  program,  and  not 
lAether  impacts,  if  any,  were  due  to  the  bilingual  program*  The 
reason  is  that  schools  vary  widely  in  terma  of  achievement  gains 
even  where  no  special  projects  are  involved*    Presumably  this 
Variation  among  schools  reflects  differences  in  student,  commun- 
ity, and  achool  characteriatics,  and  may  apply  equally  to  all 
programs  in  a  given  school* 

Locals  historical  norms*    Local  comparisons  answer  questions 
about  how  program  students  compare  to  other  students  in  other 
programs  in  the  same  district*    Of  the  large  number  of  different 
compariaons  that  may  be  possible,  maay  may  be  of  Interest  to 
diatrict  personnel*    However,  for  the  purposes  of  evaluating  the 
bilingual  programs  in  thla  study,  only  comparisons  to  similar 
students  are  of  great  interest*    These  comparisona  tell  us  i^e- 
ther  gains  are  large  or  imall  by  local  (but  not  national)  stan- 
dards*   In  addition,  where  no  changes  in  the  achool  or  context 
have  occurred  other  than  the  introduction  of  the  bilingual  pro- 
gram, comparison  to  local  norms  allows  us  to  attribute  an  im- 
provement to  the  new  (or  refined)  program*    Thus,  adequate  local, 
historical  norms  can  tell  us  a  great  deal  about  impact*  Unfor- 
tunately, few  districts  maintain  such  norms* 

Concurrent  control  or  comparison  groups*    According  to  conven- 
tional evaluation  lore,  control  groups  provide  the  best  stan- 
dards by  which  to  judge  a  program*    In  practice,  however,  such 
compariaona  are  usually  not  satisfactory  for  determining  the 
impacts  of  bilingual  programs*    For  these  programs,  comparison 
groups  are  usually  composed  of  dissimilar  students  and  there  is 
no  way  to  tell  whether  differences  in  performance  are  due  to 
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program  effects  or  student  characteristics*    Truly  randomized 
assignment  to  groups  may  not  be  appropriate^  even  If  It  were 
possible^  since  assignment  to  the  control  group  may  constitute 
a  negative  treatment  from  the  students'  perspective*    In  prlncl-* 
ple»  students  could  be  assigned  randomly  to  alternative  bilingual 
programs  In  order  to  determine  which  Is  better^  although  we  are 
not  aware  of  any  recent  studies  of  this  type  In  school  settings. 
In  short,  available,  local  comparison  groups  often  provide  little 
Information  about  program  Impact* 

•     Optimal  design*    In  combination  with  local  norms,  comparison 

groups  could  be  used  to  rule  out  distrlct-wlde  changes  that  might 
otherwise  appear  tc  be  program  Impacts*    Thus,  the  optimal  design 
for  Impact  evaluation  would  make  use  of  both  local,  historical 
norms,  and  concurrent,  local  comparison  groups* 

10*3*2*2    Comparison-standard  constraints  on  the  blllngual-PIP  study. 
As  suggested  In  ths  above  list,  the  question  of  t^ether  program  students 
performed  well  or  poorly  by  national  standards  could  be  answered  by  com- 
paring program-student  gains  to  the  norms  of  standardized  tests.  This 
question,  however,  was  only  of  secondary  Interest  In  the  study*    The  more 
Important  questlon^-^the  Impact  quest lon-^requlred  accurate  measures  of 
how  well  similar  students  had  perfomed  In  previous  years,  plus  concurrent 
comparison  groups  and  other  Information  to  rule  out  changes  In  the  student 
population,  school  program,  or  community  that  might  have  led  to  Improved 
performance.    In  most  sites,  the  required  historical  measures  were  simply 
not  available,  there  was  no  way  even  In  principle  to  reconstruct  them,  and 
thus  the  question  of  program  Impact  on  student  performance  could  not  be 
arswered  conclusively* 

In  retrospect,  there  were  several  reasons  for  the  lack  of  precise 
standards  against  which  to  judge  program  Impacts*    At  the  beginning  of  the 
study,  some  of  the  Issues  discussed  here  were  not  familiar  to  fleld^test- 
site  personnel,  and  were  not  completely  clear  to  RMC,  USOE,  or  evaluation 
specialists  In  general*    For  example,  the  technical  limitations  on  using 
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national  norms  in  impact  evaliJtations  are  only  now  beiag  explored  (by  RMC 
and  Title  I  TACs  under  this  and  other  contracts).    The  problems  with 
concurrent  comparison  or  control  groups  in  bilingual^^program  evaluations 
were  recognized*  but  the  total  impracticality  of  obtaining  groups  adequate 
for  impact  evaluation  in  most  of  the  field-test  sites  (due  to  legal»  ad- 
ministrative»  and  financial  constraints)  was  not. 

Many  of  these  problems  were  identified  early  in  the  study  and»  as 
early  as  the  fall  1977  meeting  between  RMC  and  the  local  evaluators»  the 
need  for  baseline  or  historical  normative  data  was  agree    upon.  However* 
adequate  dat    were  not  available  in  most  sites»  and  legal»  administrative* 
and  financial  constraints  precluded  collecting  the  biographical  data  that 
might  have  served  as  a  partial  substitute  for  local  achievemenf^test  norms. 
Thus»  instead  of  conclusive  measures  of  bilingual-program  iinpact»  the  most 
useful  product  of  the  impact  evaluation  may  have  been  the  preliminary 
draft  guide  to  bilingual  program  evaluation  (Volume  III  of  this  report)* 
This  draft  guide  reflects  some  of  the  new  insights  gained  in  this  study 
and  should  contribute  to  the  preparation  of  more  realistic  evaluation 
questions  for  future  diffusion  studies*  and  more  effective  evaluation 
designs  for  answering  those  questions. 
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10.4    Practical  Problems  In  AnsverinA  the  Substudy  II  Questions 

It  must  be  emphasized  that  the  issues  of  test*-to*-currlculum  match  atid 
lack  of  comparison  groups  were  only  two  of  the  many  problems  affecting  the 
credibility  of  the  impact  evaluations.    In  many  cases»  the  additional 
problems  were  completely  beyond  the  control  of  the  local  ev^iluators.  The 
major  problems  are  listed  below*  together  with  brief  Indications  as  to 
how»  If  at  al3 »  some  of  the  problems  might  be  resolved  In  future  studies. 

10.4.1    Problans  Deriving  from  the  Fleld'-Test  Design 

10.4.1.1  Variance  In  Initial  conditions.    Although  nominally  all 
sites  were  In  their  first  two  years  of  Implementing  bilingual  projects* 
there  were  tremendous  differences  In  staff  and  district  experience  in 
bilingual  education.    Some  sites  were  totally  ^^w  to  bilingual  education* 
While  others  had  had  years  of  previous  expert  This  made  It  difficult 
to  separate  results  due  to  experience  from  results  due  to  the  effects  of 
the  PIP. 

10.4.1.2  Variance  In  Implementation.    The  sites  also  varied  In  their 
implementation  of  the  projects  described  In  the  PIPs.    Some  made  only  minor 
variations  in  PIP*8pecif led  staffing  or  scheduling*  While  others  made  major 
changes  In  the  projects  and  had  student  populations  that  were  completely 
different  from  those  of  the  developer  sites.    Some  sites  were  trying  to 
implement  the  projects  as  described  In  the  PIPs*  but  were  phasing  In  the 
projects  over  periods  of  several  years*  and  thus  could  not  be  evaluated 
adequately  during  the  early  years  of  Implementation. 

Because  there  were  only  19  sites  and  many  variations  In  the  projects* 
It  was  not  feasible  to  perform  a  mathematical  analysis  relating  level  of 
implementation  to  student  performance.    Therefore*  a  case*-study  approach 
Was  followed  in  looking  at  r^utcome  evaluations  from  each  site. 

10.4.1.3  Evaluation  of  fragments  of  the  projects.    Because  of  the 
two-year  time  limit  of  the  study*  we  observed  only  the  first  three  grades 
(K^2}  of  programs  designed  to  Include  five  grade  levels.    The  sites  started 
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with  K**!  during  the  first  year^  and  expanded  to  second  grade  in  the  second 
year.    Although  gains  in  language^  inath»  and  some  other  content  areas  may 
shov  up  in  these  grades^  Improvement  in  English  readings  which  vas  not 
introduced  until  second  or  third  grade  in  some  sites^  may  be  observable 
only  iriien  the  present  students  are  in  the  third  or  fourth  grades. 

10.4.1.4    Evaluation  of  the  first  year  of  implementation.    The  first 
year  of  a  program  is  not  a  good  time  to  evaluate  impact.    Because  of  the 
oite-year^at-a-time,  upward  expansion  design  of  the  projects^  we  were  eval- 
uating, the  first  year  of  operation  for  second-grade  classes,  even  in  the 
second  year  of  the  study. 

10.4*1 -5    Testing  of  young  children.    Because  second  grade  was  the 
highest  gradA  included  in  the  study,  the  reliability  and  validity  problems 
of  testing  young  children  introduced  a  major  source  of  uncertainty  in  the 
results.    In  kindergarten,  the  curriculum  content  is  especially  difficult 
to  test.    In  all  three  grades,  children  have  relatively  short  attention 
spans  and  limited  test^taking  experience.    Some  misinterpret  instructions 
and  lack  the  mechanical  skills  required  to  take  the  tests. 

10*4*2    Problems  Tv>)ical  of  Local  Program  Evaluations 

10.4.2.1    Undefined  project  goals.    The  first  step  In  designing  the 
evaluations  was  intended  to  be  the  specification  of  program  goals  and  ob- 
jectives in  a  form  suitable  for  evaluation.    For  most  sites ,  specification 
in  sufficient  detail  was  not  possible  during  the  two  years  of  the  study, 
since  project  personnel  were  feeling  their  way  to  a  great  extent.    By  and 
large,  project  directors  simply  did  not  know  exactly  when  students  should 
be  using  which  languages  and  to  what  degree,  nor  did  they  know  in  which 
subject  areas  they  expected  major  project  impacts.    In  addition,  the  nomi- 
nal project  goals  sometimes  conflicted  with  district  goals.    The  only  real 
solution  to  this  problem  is  to  continue  outcome  evaluation  activities  until 
realistic  program  goals  have  been  firmly  established,  rather  than  attempt*^ 
ing  to  produce  definitive  results  in  the  formative  stages  of  the  program. 
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10.4.2.2  Describing  students.    In  order  to  Interpret  student  achieve^ 
ment  gains.  It  Is  necessary  to  have  an  accurate  picture  of  the  entering 
skills  and  the  previous  experience  of  the  students.    One  o£  the  most  im-^ 
portant  skills  In  a  bilingual  program  Is  language  skill,  and  this  must  be 
measured  In  the  native  language  as  well  as  In  English.    While  several  te&ts 
are  widely  used  for  this  purpose,  none  of  the  sites  was  completely  satis- 
fied with  either  the  effort  required  to  administer  the  tests  or  the  accur- 
acy of  the  results.    Improvements  In  this  area  are  within  the  state-of- 
the-art,  but  will  Involve  major  research  and  development  efforts  and  are 
definitely  beyond  the  capabilities  of  Individual  LEAs  or  of  studies  such 

as  the  PIP  field  teat. 

In  addition  to  language  skills.  It  Is  necessary  to  know  where  each 
student  stands  on  a  number  of  biographic  and  demographic  varlates.  This 
Information  Is  esaentlal  for  the  Interpretation  of  gains  when  comparing 
students  to  control  groups  or  against  any  other  standard.    This  Informa- 
tion Is  seldom  reported  but  could  be  collected  easily  given  proper  guide-* 
lines  and  resources.    No  technological  breakthroughs  are  required.  Sev- 
eral sites  made  substantial  efforts  In  this  area  during  the  second  year. 

10.4.2.3  Finding  technically  adequate  tests.    The  better-known  stan- 
dardized tests  In  English  are  all  fairly  satisfactory  In  terms  of  reli- 
ability.   The  validity  of  these  tests  as  measures  of  bilingual-project 
Impacts  has  been  widely  questioned.    Only  a  few  standardized  tests  are 
available  In  ipanlsh,  and  virtually  none  In  most  other  languages.  So 
called  criterion-referenced  tests  are  somewhat  more  available,  but  are 
not  usually  suitable  for  measuring  project  Impact  due  to  their  poor  psy- 
chometric properties  (see  Appendix  B  In  Tallmadge  and  Horst,  1975). 

Aside  from  content  problems,  the  major  practical  problem  was  the 
selection  of  appropriate  levels  of  the  tests*    A  large  proportion  of  the 
sites  experlenccsd  floor  effects  (especially  In  the  first  grade),  which 
result  In  mean  scores  for  the  groups  that  are  unreallstlr.ally  high.  Where 
this  occurs  on  a  pretest,  the  amount  of  apparent  Impact  Is  reduced. 
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Test  development  is  a  well-established  fields  and  better  tests  for 
evaluating  bilingual  projects  could  be  constucted.    However,  It  would  be 
a  very  difficult  and  costly  Job  If  done  correctly^  and  the  commercial 
test  publishars  are  constrained  by  many  economic  and  practical  consider- 
ations.   Selecting  the  correct  level  of  a  test  can  be  done  quite  readily 
v5.th  a  llctle  pilot  testings  but  this  takes  time  and  money  at  the  local 
level . 

10.4.2.4    Collecting  and  analyzing  the  data.    In  practice,  no  area 
Is  better  understood  or  more  generally  abused  than  the  collecting  and 
processing  of  test  scores,    tt  is  well  known  to  all  evaluators  that  test- 
ing conditions  must  be  orderly  and  carefully  standardized >  and  that  test- 
ing must  occur  in  reasonable  time  periods.    Nevertheless^  many  sites  had 
minimal  training  of  testors  during  Khe  first  year»  and  testing  dates  for 
fall  pretesting  slipped  badly  in  several  sites.    For  the  second  year»  RMC 
arranged  site  visits  to  coincide  with  testing  periods  in  most  sites^  and 
found  that»  while  a  variety  of  problems  remained^  testing  problems  had 
been  greatly  reduced  in  many  sites. 

Data  analysis  is  also  well  understood  by  most  of  the  field--test-site 
evaluators^  but  first  year  reports^  due  in  part  to  time  pressures^  abounded 
with  Inappropriate  or  ir^omplete  analyses*    With  the  increased  emphasis  on 
outcome  evaluation  in  the  second  year  of  the  study >  RMC  was  able  to  rean- 
alyze results  from  the  infcrmation  provldeil  by  many  o^  the  sites^  together 
wit^  Information  from  RMC  site  visits  but>  for  some  sites>  the  basic  data 
were  simply  unavailable. 
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11  •    EVALUATION  OF  ACHIEVEMENT  IMPACTS: 
PROCEDURES  AND  RESULTS 


11.1    Subfltudv  II:    Year  One 

Because  of  the  start-up  status  of  the  projects*  first^year  impact 
data  were  of  secondary  Interest*    The  major  purpose  of  the  flrst^year 
impact-evaluation  e£fort  was  to  work  out  any  problems  so  that  all  field- 
test  sites  could  have  adequate  evaluations  in  place  by  the  start  of  the 
second  year* 

11*1*1    First-^Year  RMC  Activities 

11*1*1*1    AuRust  1977  meetinR  with  field-test-site  Personnel*  The 
first  meeting  between  RMC  ^nd  the  local  evaluators  (and  project  directors) 
was  held  in  conjunction  with  the  OBE  Silver  Spring*  Maryland*  meeting  of 
PIP  adopter-site  project  directors  in  August  1977*    RMC  was  allotted  one 
afternoon  at  this  meeting  to  present  some  basic  evaluation  design  guide-- 
lines on  choosing  tests  and  comparison  groups*  and  to  obtain  reactions 
from  the  LEA  representatives  as  to  the  effects  of  these  guidelines  on 
their  plans* 

It  quickly  became  apparent  that  the  brief  presentation  would  not 
result  in  evaluations  that  met  RMC  criteria  for  credibility*    A  large 
proportion  of  the  sites  requested  Immediate  individual  assistance  at  a 
more  detailed  level »    Local  problems  ran  the  complete  gamut^-from  district 
constraints  on  test  selection*  lack  of  useful  comparison  groups*  and  ab- 
sence of  clearly  stated  project  objectives*  to  the  lack  of  any  evaluator 
at  all*    In  most  sites*  evaluators  had  just  started  working*  and  only  a 
few  had  had  a  chance  to  consider  all  of  the  issues  raised  by  KMC* 

11.1.1.2    September  1977  workshop  for  evaluators  and  Project  direc- 
tors*   In  an  attempt  to  finalize  local  evaluation  designs  and  produce  the 
desired  uniformity  among  sites*  RMC  organized  a  two-day  workshop  in  Palo 
Alto  for  mid-September*    The  topics  covered  included: 
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•  Identifying  project  goals  to  be  evaluated* 

•  Developing  an  evaluation  design  (finding  a  comparison)  for  each 
goal* 

•  Selecting  project  students  and  comparison  groups* 

•  Selecting  tests  (both  technical  issues,  and  matching  of  tests 
to  goals) * 

•  Data  collection  procedures  for  fall  pretests* 

•  Initiating  local  test  development* 

•  Site^specific  problems  and  topics  requested  by  sites* 

For  most  topics,  an  KMC  presentation  was  followed  by  group  discussion* 
Then  each  project  director  and  local  evaluator,  using  structured  work* 
sheets,  attempted  to  apply  the  principles  that  had  been  agreed  upon  to 
their  local  situation* 

RMC  was  immediately  impressed  by  the  technical  sophistication  of  the 
local  evaluators,  who  were  generally  aware  of  the  problems  discussed  in 
the  workshops  and  ready  to  share  their  own  findings  and  attempted  solu*- 
tions*    However,  most  faced  local  constraints  in  specifying  goals,  finding 
comparison  groups,  selecting  and  administering  tests,  and  other  critical 
areas*    In  addition,  most  were  hired  from  outside  of  the  LEAs  themselves, 
and  many  faced  severe  time  constraints  (e*g*,  as  little  as  20  to  25  days 
to  design  the  evaluation,  organize  fall  and  spring  testing,  and  train 
testors,  process  and  analyze  both  sets  of  data,  write  the  evaluation  re* 
port,  and  provide  in*person  feedback  to  teachers  and  administrative  per* 
sonnel).    The  net  result  was  that  :.be  workshop  ended  with  general  con- 
sensus on  principles  that  should  be  followed  in  all  the  local  evaluations, 
but  with  considerable  uncertainty  in  all  sites  as  to  how  these  principles 
could  be  carried  out  in  practice* 
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11*1*1.3    FlrBt"year  site  visits*    RldC  attempted  to  pursue  specific 
problems  with  each  site  during  the  October  site  visits,  and  to  follow  up 
during  winter  and  spring  visits  as  well  as  via  telephone  and  mall*    By  the 
end  of  the  :.prlng  visits^  however,  It  was  clear  that  the  Impact  of  the  KMC 
effort  on  the  first-year  evaluations  had  been  minimal*    The  gcod  Intentions 
of  the  local  evaluators  had  been  largely  subverted  by  the  constraints  of 
time,  local  conditions,  and  LEA  policies*    The  1       of  convincing  first- 
year  evaluations  was  of  no  great  concern,  as  noted  above,  but  there  was 
major  coucern  over  the  fact  that  few  of  the  sites  showed  promise  of  much 
Improvement  for  Llie  second  year*    In  an  attempt  to  Improve  the  second  year 
evaluations,  RMC  organized  a  second  special  meeting  of  evaluators  and 
project  directors — this  time  held  for  three  days  in  San  Jose,  California, 
July  1978* 

11*1*1*4    July  1978  seminar  f^r  evaluators  and  project  directors* 
The  July  /seminar  was  organized  differently  from  the  workshop  of  the 
previous  September  In  two  respects*    First;  It  was  much  more  directive, 
and  focused  vi^ry  specifically  on  the  key  evaluation  problems  identified 
during  the  first  year*    Second,  the  RMC  role  as  presenters  was  greatly 
reduced*    Instead,  much  of  the  first  two  days  ?£  the  seminar  consisted 
of  presentations  Dy  the  experienced,  local  evaluators  explaining  their 
solutions  to  particular  problems,  and  of  group  discussions  attempting  to 
reach  consensus  on  the  best  ways  to  deal  with  the  unsolved  problems*  The 
areas  of  greatest  concern  were; 

•  lack  cf  any  meaningful  standards  of  comparison  fjv  project  im- 
pact* 

•  lack  of  match  aiEong  project  goals,  curricula,  and  tests* 

•  lack  of  adequate  assessment  of  language  proficiency* 

•  inadequate  testing  procedures* 

<ixclusion  of  affective  and  other  project  goals  from  the  evalu- 
anion  designs* 


219 


The  third  day  of  the  seminar  was  spern  In  a  review  by  each  project  director 
and  evaluator  of  their  own  evaluation  design  and  on  an  attempt  to  organize 
a  cooperative^  cross'-^lte  comparison  group  (a  sort  of  mini  norm  group)  by 
pooling  the  data  from  the  small  numbers  of  control  students  reported  to  be 
available  at  many  sites* 

The  seminar  broke  up  on  a  note  of  enthusiasm  and  commitment  from  the 
entire  croup,  although  specific  Issues  remained  unresolved  at  all  sites* 
RMC  agreed  to  coordinate  the  cross-sit e-comparlson-group  effort  as  well 
as  a  parallel  effort  to  collect  student  biographical  data  for  use  with 
either  the  ^ross*slte,  or  local,  historical  comparison  groups*  Evaluatord 
and  project  directors  resolved  to  return  to  their  districts  and  take  up 
the  unresolved  Issues  with  the  appropriate  administrators* 

11*1*1*5    Seminar  follow-up  activities*    In  the  week  following  the 
seminar,  BMC  generated  the  forms  and  guidelines  requested  by  the  sites  for 
collecting  biographical  data,  and  prepared  a  summary  of  seminar  recommen- 
dations In  all  the  major  areas  of  concern*    In  subsequent  weeks,  all  sites 
were  followed  up  by  telephone  to  encourage  them  to  finalize  their  designs 
and  to  d'^termlne  to  what  extent  they  could  contribute  to,  or  profit  from, 
the  cross"sltC  comparison  group*    By  the  beginning  of  September  It  was 
clear  that  the  effects  of  the  seminar  and  follow-up  activities  had  been 
minimal  In  most  sites* 

11*1*1*6    Preparation  of  slte'^speclf Ic  evaluation  recommendations* 
With  second-year  pretesting  due  to  begin  shortly,  and  many  sites  still 
without  defensible  decisions  on  comparison  groups,  test  selection  and  othrr 
major  Issues,  BMC  prepared  specific  recommendations  In  the  following  areas 
(see  Figure  lA): 

•  Describing  student  language  skills,  demographic,  and  biographic 
characteristics ; 

•  Providing  a  meaningful  comparison  group; 
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Minimal  Criteria  for  Interpretable 
Impact  Evaluations 

General  Comments 

Describe  Students 

The  students'  environment »  entering  lan- 
guage skilly  and  previous  training  gen- 
erally have  more  impact  on  test  scores 
than  do  Instructional  programs.  These 
factors  must  be  known  if  evaluations 
are  to  be  Interpretable. 

The  comparison  group  determines  which 
questions  can  be  answered.  Probably 
the  most  important  policy  question  is 
whether  students  consist^tly  do  better 
in  bilingual  programs  than  in  conven- 
tional classrooms.    Other  questions 
that  may  be  of  interest  are: 

•  Are  bilingual  projects  better  than 
ESL  projects? 

•  Is  a  particular  bilingual  project 
better  than  the  average  bilingual 
project  in  the  region? 

•  Etc. 

InterAmerican  (Spanish  &  English)  Level 
I  Reading  and  Math:  Difficult  for  1st 
and  2nd  grades  (floor  effects). 

CTBS  Level  B:     Somwhat  difficult  at  be- 
ginning of  Grade  1*    OK  at  end. 

CTBS  Level  C:    OK  at  beginning  of  Grade 
Somewhat  easy  at  end  (possible 
ceiling  effects). 

1.  Language  Proficiency  -  Pretest  all 
project  students  with  LAS  or  equiva- 
lent test  of  oral  production 

2.  Demographic  &  Biographic  Data  -  Col- 
lect it^s  of  information  listed  on 
attached  sheet 

Provide  Meaningful  Comparison  Groups 
1.  Minimum  comparison  (listed  in  order 
of  generally  increasing  credibility) 

A.  Regional  norms 

B.  Local  historical  data 

C.  CrosS'-site  comparison  group 

D.  Advanced  cohort  design 

E*  Local  comparison/control  group 
2*  Local  comparison/control  group  in 
combination  with  one  of  A'-D 

Use  Technically  Adequate  Achievement 

Tests 

1.  Grade  1:  CTBS  Level  B  or  equivalent 
Grade  2:  CTBS  Level  C  or  equivalent 
(Form  Sf  English  &  Spanish  versions) 

Figure  14*    General  impact  evaluation  guidelines  for  PIP 
field-test  siteSf  Septanber  1978. 


Minimal  Criteria  for  Interpretable 
Impact  Evaluations 

General  Comments   

Match  Tests  to  Proiect  Curriculum 

In  order  to  demonstrate  benefits  from  a 
prolectt  vou  must  test  the  sublect 
areas  and  the  specific  content  In  which 
the  students  benefit*    You  must  also 
consider  when  beneflte  are  expected  In 
each  content  area  (I.e.,  K,  1,  2?) 

The  perfect  design  Is  of  no  value  unless 
the  data  are  clean.    It  Is  out  Impres*- 
slon  that  many  PIP  sites  had  major 
testing  problems  during  the  first  year. 

1*  Nominal  match 

A*  Reading:  Spanish  &  English 
B*  Math:  Language  of  Instruction 
C*  Oral  Language:  (E&S)  uvS  or 
equivalent  (pre  &  posttest) 
D*  Affective:  ARS  or  equivalent 
(Bob  Olsen) 
2*  Systematic  Match  of  subtest  Itois 
to  curriculum  content 

Use  Adequate  Testing;  Dates  and  Scorln$^ 
Procedures 

1*  •  Careful  training  for  testors 
«  Test  reading  and  math  between 

October  1  and  31 
•  Verify  scoring 

Figure  14.  (continued) 
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•     Selecting  technically  adequate  achievement  tests; 


•  Hatching  tests  to  project  curricula; 

•  Testing  and  data  processing  procedures. 

Then  for  each  site»  RMC  prepared  an  individual  summary  of  exactly  what 
we  perceived  tc  be  wrong  with  their  evaluation  in  each  of  the  above  areas. 
For  each  problem  area»  specific  tests»  comparison  groups^  testing  proce*- 
dures»  and  so  on  were  recommended.    The  impacts  of  these  recommendations 
are  described  below.    Iti  general*  the  most  practicable  recommendations 
concerned  changes  in  the  tests  being  used  in  some  sites.    In  the  troubled- 
some  area  of  comparison  groups*  RMC  was  no  better  able  than  were  the  local 
evaluators  to  create  such  groups  where  none  existed. 

11.1.2    RMC  Impacts  on  Field*Test-Site  Evaluations 

11.1.2.1    Impacts  on  evaluation  designs.    By  the  end  of  the  first 
year»  the  Impacts  of  RMC  workshops  and  consulting  were  more  limited  than 
RMC  had  hoped.    In  general^  this  was  not:  because  of  any  conflict  between 
nominal)  local  evaluation  goal&  and  RMC  study  goals.    The  same  problems 
that  made  the  evaluations  inadequate  for  RMC's  purposes  also  made  them 
inadequate  to  meet  nominal*  local  needs.    Ifowever»  the  realities  of  local 
project  evaluation  encourage  evaluators  to  search  for  evidence  of  positive 
impacts  rather  than  to  develop  the  most  accurate  picture  of  total  project 
impact.    In  addition*  local  evaluators  faced  constraints  of  time  and  of 
entrenched  local  evaluation  practices.    Then  too»  there  were  no  conditions 
in  their  grants  compelling  them  to  follow  RMC  recommendations»  nor  had  they 
made  provisions  in  planning  or  budgeting"  to  do  so.    The  RMC  contract  did 
not  provide  for  actually  conducting  outcome  evaluation  activities  at  the 
tfites»  and  with  no  pat  solutions  to  offer»  RMC  arguments  had  only  moderate 
weight.    In  the  final  analysis*  local  pressures  and  constraints  were  the 
major  factors  in  shaping  the  evaluations. 

It  is  reasonable  to  ask  at  this  point  whether  any  major  improvement 
in  che  designs  could  be  possible.    The  answer  is  that  many  of  the  problems 
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could  be  readily  eliminated  given  the  resources  and  the  motivation  to  do 
so.    However,  producing  truly  credible  impact  evaluations  would  require 
long-term  programs  to  develop  local  norms,  and  would  involve  major  changes 
in  selection  of  tests,  testing  schedules,  and  so  on.    Most  districts  will 
not  make  such  changes  lightly  and,  in  particular,  they  will  not  make  them 
to  accommodate  a  single  program  without  conviction  that  the  changes  will 
be  of  real  benefit  to  the  district. 

11. 1.2.2    Impacts  on  evaluation  reports.    It  was  originally  intended 
that  RMC's  primary  source  of  outcome  data  would  be  the  evaluation  reports 
prepared  by  the  field-test  sites  for  submission  to  Title  VII.    With  this 
in  mind,  RMC  devoted  some  time  at  each  of  the  evaluation  seminars  to  the 
subjects  of  report  content  and  format.    As  e^c  began  receiving  copies  of 
the  second-year  reports  in  August  and  September  of  1979,  it  quickly  became 
clear  that  the  RMC  recommendations  had  had  little  or  no  impact.    Most  of 
the  reports  failed  to  Include  the  basic  information  necessary  for  inter- 
pretability  of  mean  test  scores  (i.e.,  test  level  and  publication  date, 
type  of  score,  number  of  students,  standard  deviation)*    None  covered  the 
complete  set  of  essential  topics  (i.e.,  students'  incoming  skills  and  ex- 
perience, program  instructional  characteristics,  test-c:»ntent  match,  test- 
ing procedures,  and  analysis  procedures),  at  even  a  rudimentary  level. 
MosL  unfortunately,  few  discussed  the  plausibility  of  the  remarkably  large 
gains  that  were  often  reported  (see  Appendix  D) ,  and  few  Lied  these  gai^is 
logically  to  any  specific  instructional  treatments. 

Because  of  the  lack  of  precident  for  major  impacts  by  special  pro- 
grams, we  believe  that  the  burden  of  proof  lies  with  the  evaluator  and, 
while  the  PIP  field-test-site  reports  were  certainly  no  worse  than  other 
local  evaluation  reports  for  bilingual  or  other  programs,  few  of  them 
could  be  considered  even  moderately  convincing.    Since  we  knew  that  most 
of  the  PIP-site  evaluators  understood  the  issues  involved,  we  assumed  that 
the  problems  with  the  reports  were  dua  to  time  pressures,  plus  the  pres*- 
Sure  to  show  positive  results,  in  combination  with  the  lack  of  any  pres- 
sure to  prodjce  accurate,  convincing  evaluations.    This  issue  is  discussed 
further  under  "second^year  results,"  Section  U-2.3. 
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11*1*3    Synopsis  of  Flrst*-Year  Evaluations 


The  summaries  Included  her6  are  taken  from  the  16  final  1977*1978 
reports  received  by  RHC*    In  these  reports^  most  evaluators  demonstrated 
an  understanding  of  vould  constitute  an  Ideal  evaluation  paradigm* 

However^  available  resources^  especially  evaluator  time*  varied  widely 
frow  site  to  site*    Thu8»  even  vlth  excellent  technical  skills*  the  best 
of  Intentions*  and  the  professional  support  of  the  other  adopters-site 
evaluators  and  the  BMC  staff*  many  sites  vere  unable  to  produce  adequate 
evaluation  reports  during  the  first  year*    In  most  cases  vhere  evaluators 
did  have  the  time  and  other  resources  needed  to  address  all  of  their  tasks 
the  problems  discussed  In  the  preceding  section  precluded  truly  convlnc** 
Ing  evaluation  reports* 

11*1*3*1    Description  of  students*    Seven  different  measures  were 
used  to  assess  the  language  proficiency  and  dominance  of  the  students  In 
th£  ten  Spanish  language  sites  alone*    Rather  than  being  used  to  demon- 
strate growth*  these  data  were  collected  primarily  for  the  purpose  of 
student  selection  and  legal  coiiipllance»  and  were  not  always  Included  In 
the  final  reports* 

When  achievement  data  were  Interpreted  with  reference  to  the  lan- 
guage proficiency  of  the  project  students  (LES/NES  vs*  FES) >  the  criteria 
by  vjhlch  such  designations  were  made  were  rarely  provided*    Since  some 
tests  of  language  proficiency  have  bullt'-ln  cutoff  scores^  the  sites  may 
have  relied  on  those  criteria*    For  the  purpose  of  selecting  students^ 
scores  on  tests  of  language  proficiency  were  often  combined  with  teacher 
Judgment  * 

Only  two  of  the  16  reports  presented  any  biographic  data  collected 
on  individual  students  for  either  the  project  or  control  groups*  Such 
lnformaMon»  vjhen  It  was  provided^  Included:    (a)  whether  the  child  was 
enrolled  In  any  other  special  projects^  (b)  the  socioeconomic  status  of 
the  child's  family*  and  (c)  the  language  spoken  by  the  child  at  home* 
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By  contrast,  eleven  sites  provided  substantial  Information  suimiarlz- 
Ing  the  demographic  characteristics  of  the  school  or  comnmnity  In  which 
the  project  was  located.    These  data  most  frequently  included  the  size, 
ethnic  composition,  Industry,  and  occupations  of  the  area.    Statistics  on 
rates  of  absenteeism  were  reported  by  only  three  sites.    Project  Impact 
was  never  Interpreted  In  light  of  these  biographic  and  demographic  charac-^ 
terlsllcs,  which  were  provided  merely  for  purposes  of  describing  the 
project  context. 

11.1.3.2    Comparison  groups.    Considering  the  many  groups  for  which 
project  outcomes  were  to  be  evaluated  (English  and  Spanish;  math,  oral 
language,  and  reading;  grades  K,  1,  and  2)f  It  is  not  surprising  that  most 
sites  applied  several  different  evaluation  strategies  In  an  effort  to  use 
the  best  procedure  possible  In  each  situation.    For  one  site,  this  Included 
the  use  of  historical  data,  national  norms  and,  where  no  other  choice  was 
available,  the  computation  of  raw^'score  gains.    Although  the  use  of  the 
historical  data  necessitated  making  some  untested  assumptions  concerning 
summer  loss  and  other  factors.  It  remained  a  significant  Improvement  over 
simply  reporting  posttest-mlnus-pretest  scores. 

A  comparison-group  design  using  either  adjusted  or  unadjusted  post- 
test  scores  was  used  to  evaluate  one  or  more  project  components,  at  a  total 
of  seven  &'tes.    In  about  half  of  these  cases,  assignment  to  project  or 
comparison  groups  approximated  a  random  basis,  while  In  the  oti  ers  the 
comparison  was  made  to  local  students  enrolled  In  the  stater's  tlllngual 
program,  and  selection  statistically  biased.    Instruction  In  tte  latter 
seemed  to  be  regarded  as  only  minimally  different  from  the  Instruction 
received  In  the  regular  non-blllngual  classroom. 

National  norms  were  used  to  derive  a  no-project  expectation  In  five 
sl'rs.    The  late  arrival  of  tests,  the  ahsence  of  Spanish  language  norms 
and  the  apparent  contamination  of  existing  norms ^ made  such  a  design  only 
minimally  applicable.    Finally,  of  the  16  sites,  six  relied  upon  the 
analysis  of  unadjusted  pre-  to  posttest  gains  to  evaluate  some,  i£  not 
all  of  their  project  components. 
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In  a  few  cases »  an  object,  ve  was  set  such  that  any  raw-score  gain 
satisfied  the  expectation.    The  rational  for  selecting  a  particular 
raw-gain  criterion  was  never  provided.    In  some  of  these  cases,  where  it 
was  possible  to  relate  the  gain  objective  to  the  national  (or  local) 
standard  deviation*  it  was  found  (by  RMC)  to  represent  a  trivial  expecta- 
tion.   In  the  one  or  two  of  these  cases  where  raw  gain  objectives  could 
be  related  to  percentiles »  the  expected  gain  actually  represented  a  loss 
in  percentile  standing  from  pre-  to  posttest.    Working  to  achieve  such 
small  gains»  the  objective  was  often  far  surpassed  and  looked  deceptively 
Impressive.    However,  in  other  sites,  program  students  made  substantial 
gains  with  respect  to  the  national  norms  (ste  Appendix  D) . 

11.1*3.3    Selection  of  achievement  tests.    A  total  of  eight  nationally 
standardized  tests  was  used  to  assess  achievement  outcomes  in  the  English 
language.    These  included: 

•  Test  of  Basic  Experiences  (TOB£) 

•  Inter-American 

•  Comprehensive  Test  of  Basic  Skills  (CTBS) 

•  Gates-McGinitie  Reading  Tests 

•  Boehm  Test  of  Basic  Concepts 

•  SRA  Achievement  Series 

•  California  Achievement  Test  (CAT) 

•  Metropolitan  Achievement  Tests  (MAT) 

Most  often  selected  were  the  SRA,  TOBE,  and  CTBS,  used  by  three  sites  each 
to  measure  outcomes  in  at  least  one  grade  level.    Five  sites  administered 
more  than  one  of  the  eight  tests*    The  Spanish  language  versions  of  the 
Inter^America  :  and  CTBS  were  also  administered. 

Means  and  standard  deviations  summarizing  project-  and  control-group 
scores  at  pretest  and  posttest  indicated  that,  for  eight  of  the  sites, 
the  influence  of  floor  effects  threatened  the  validity  of  the  findings 
presented.    When  the  problem  occurred,  it  was  usually  at  pretest  and  was 
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often  (although  not  always)  with  LES/NES  students  being  tested  in  a  lan- 
guage in  which  they  had  not  yet  received  any  formal  instruction. 

The  problem  of  ceiling  effects  hindered  the  interpretation  of  data 
from  only  two  of  the  14  sites»  one  of  which  acknowledged  the  problem  to 
the  extent  that  i^  rejected  the  data  prior  to  analysis.    A  few  additional 
sites  indicated  that  data  had  been  eliminated  because  they  were  considered 
invalid.    Although  the  reasons  behind  such  decisions  were  not  provided*  it 
is  likely  that  in  most  cases  it  was  because  of  floor  or  ceiling  effects. 

11.1.3.4    Testing  procedures.    Since  RMC  did  not  observe  testing 
during  the  first  year  of  the  contract »  it  was  not  possible  to  comment  on 
the  adequacy  of  the  conditions  under  which  testing  took  place.    It  is 
quite  possible  that  the  frequent  encounters  with  test  floors  represented 
problems  with  the  test  administration  (e.g.»  lack  of  adequately  trained 
proctors)  as  often  as  they  reflect  the  ability  level  of  the  students 
tested. 

In  general)  these  findings  indicate  that  inadequate  attention  was 
paid  to  selecting  test  content  or  levels  appropriate  to  the  students  and 
the  curriculum  being  evaluated.    Hone  of  the  sites  indicated  that  they 
had  carried  out  any  kind  of  systematic  content-to-curriculum  match  to 
select  tests  for  the  first  year  of  the  project,  although  many  had  indi- 
cated an  intention  to  switch  tests  in  the  second  year.    Subsequent  exami- 
nation by  RMC  of  the  second-year  data  indicated  that  floor  and  ceiling 
effects  were  not  a  major  problem  in  most  sites,  especially  for  second- 
grade  students. 
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11*2    SubstudY  II;    Year  Two 

Outcome-Evaluation  Activities:    Year  2 

Where  the  major  role  of  HMC  In  the  first  year  was  to  assist  adopter- 
sites  In  the  design  of  evaluatlona^  the  intended  role  for  the  aecond  year 
was  to  interpret  the  results  of  the  local  evaluations  and  to  combine  the 
results  to  provide  an  accurate  answer  to  the  Impact  questlo^^a.    By  the 
end  of  the  first  year,.  It  was  clear  that^  for  two  reasons^  the  ansT^^er  to 
these  questions  would  te  less  conclusive  than  could  be  desired — firsts 
for  the  reasons  discussed  under  Process  Evaluation^  above^  relatively 
little  grouping  ot  sites  by  PIP  or  other  study-relevant  variables  appeared 
Justified.    Second^  as  a  result  of  the  evaluation  problencs  discussed  In 
Section  lOt  It  was  clear  that  the  local  evaluations  would  not  provide  pre- 
cise measures  of  project  Impact.    For  these  reasons^  the  continuing  study 
of  evaluation  problems  and  the  development  of  evaluation  methodology  was 
perhapa  the  most  productive  activity  of  the  second  year  of  the  study. 

The  second-^year  evaluations^  however^  represented  a  considerably 
greater  level  of  effort  on  the  parts  of  rmC  snd  local  evaluators  than  did 
first-year  evaluations*    The  preceding  sections  have  indicated  that>  In 
spite  of  this  high  level  o^  effort »  the  resulting  evaluations  did  not 
produce  credible  estimates  of  program  impacts.    This  section  describes 
the  development  of  procedures  for  Judging  credibility  and  discusses  the 
credibility  results  for  the  f leld-test-slte  Impact  evaluations. 

11.2.1    Preliminary  Review  of  Achievement  Impact  Results 

During  the  second  year  of  the  field  test»  EtMC  vlslt'^.d  most  of  the 
sites  In  both  fall  and  spring.    At  least  one  of  these  visits  was  sc^  ad- 
uled  to  coincide  with  local  testing  so  that  a  general  Impression  of  test- 
ing procedures  could  be  obtained.    During  these  visits  HMC  staff  also 
discussed  the  progress  of  the  evaluations  with  the  local  evaluators. 

At  HMC's  request^  several  of  the  sites  provided  HMC  with  both  fall 
and  spring  test  data  shortly  after  completion  of  spring  1979  testing. 
Completed  evaluation  reports  were  received  from  most  of  the  sites  during 
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cbe  latB  Summer  and  early  fall.  All  of  this  Information  was  examined  by 
RMC  from  ti\e  perspective  of  the  Impact  of  the  PIP  diffusion  effort.  The 
question  of  Interest  was — *'Dld  the  bilingual-program  students  learn  more 
than  they  would  have  learned  If  the  PIP-dlf fusion  effort  had  not  existed?'* 

In  attempting  to  answer  this  question  all  site  reports  and  additional 
data  were  screened  at  a  preliminary  level  following  procedures  developed 
previously  by  RMC  (Tallmadge  and  Horst,  1975;  Horst  1978)  for  validating 
achievement  gains  In  educational  projects.    Detailed  application  of  these 
procedures  requires  access  to  data  that  are  not  generally  Included  In  eval-* 
uatlon  r<?ports  and  therefore,  as  a  pilot  effort,  RMC  selected  two  sites 
that  had  supplied  achievement  test  data  for  Individual  students.  (Student 
names  were  removed  by  the  sites  to  preserve  confidentiality.)    The  data 
from  these  sites  were  examined  exhaustively  to  rule  out  common  evaluation 
artifacts.    Mean  scores  were  checked,  distributions  of  pretest-*posttest 
scores  were  plotted  and  checked  for  anomolles,  effects  of  dropouts  were 
computed.  Individual  score  protocols  and  item  data  were  examined,  and, 
finally,  raw  or  percentile  scores  were  converted  to  standard  scores. 

While  a  few  minor  discrepancies  were  found,  by  and  large*  the  results 
supplied  by  these  two  sites  were  accurate.    The  data  showed  that,  as  com^ 
pared  to  the  norm  group  for  the  CTBS-'73,  the  bilingual  program  students 
In  aeco  d  grade  had  made  substantially  larger  gains  In  English  reading  and 
math  from  pretest  to  posttest.    Large  gains  were  also  reported  for  the  CTBS/ 
Espaflol-'78  in  reading  and  math.    As  a  further  check,  English  reading 
data  from  these  same  students  were  examined  after  pretesting  third  grade 
In  the  fall  of  1979.    These  data  Indicated  that  the  gains  were  stable  and 
long  lasting. 

While  the  results  from  these  sites  were  encouraging.  It  was  not 
clear  to  what  extent  the  new  programs  were  responsible  tor  these  gains. 
It  was  also  clear  that  many  of  the  remaining  factors  that  lead  to  uncer-* 
talnty  In  local  evaluation  results  could  be  checked  quite  easily  In  the 
remaining  site  reports,  and  that  these  checks  should  be  made  before  Invest- 
ing the  time  required  to  obtain  and  process  data  from  the  additional  sites. 
Therefore,  procedures  for  assessing  the  credibility  of  the  Impact  results 
were  formalized,  tried  out,  revised,  and  applied  to  all  of  the  available 
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f ield^test-site  evaluations*    These  procedures  and  the  credibility  results 
are  described  in  the  following  sections. 

11.2.2    Development  of  Credibility  Rating  Procedures 

The  impact  evaluation  component  of  the  bilingual-PIP  field  test  was 
added  to  the  study,  at  least  in  part,  because  of  the  intense  interest  on 
the  parts  of  USOE  and  other  educators  in  the  impacts  of  bilingual  educa- 
tion.   From  the  beginning  of  the  study,  HHC  took  the  position  that,  due 
to  the  controversy  surrounding  the  topic,  it  was  important  not  to  report 
misleading  or  erroneous  Impact  results.    In  practice,  this  meant  vaXidatir^ 
the  accuracy  of  all  results — positive,  negative,  or  neutral — and  reporting 
only  those  meeting  at  least  minimal  standards  of  credibility.  Therefore, 
for  the  purposes  of  this  study,  ad  hoc  credibility-rating  procedures  were 
establishes^,  and  these  procedures  are  described  here  in  some  detail. 

U.2.2.1    Credibility  of  available  information.    Ultimately,  the  cred- 
ibility ratings  were  based  upon  professional  judgment,  which  is  to  say  they 
were  primarily  subjective,  but  considerable  effort  was  expended  in  making 
the  judgments  as  systematically  and  reliably  as  possible.    The  first  step 
was  to  divide  the  potential  threats  to  credibility  into  seven  categories 
(Figure  15).    The  first  five  categories  covered  the  adequacy  of  the  avail- 
able information.    The  ratings  in  these  categories  addressed  the  general 
question-**Is  there  enough  information  to  produce  a  credible  impact  evalu- 
ation? 

11.2.2.2    Credibility  of  data  analysis.    Section  II,  Data  Analysis 
(the  sixth  category)  addressed  the  appropriateness  of  the  processing  and 
statistical  analysis  of  the  information.    For  the  purposes  of  this  study, 
it  was  decided  that  the  analysis  should  not  be  rated  as  any  mors  credible 
than  the  least  credible  category  of  information  (i.e.,  the  lowest  value 
from  categories  one  through  five  should  provide  the  upper  limit  for  the 
credibility  of  the  statistical  analysis  (category  six).    However,  it  would 
be  possible  to  have  highly  credible  information  in  categories  one  through 
five  that  was  analyzed  inappropriately.    In  such  cases,  the  analysis  would 
be  rated  as  less  credible  than  any  of  the  preceding  five  categories. 
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X*  Data  Availability  and  Quality  (is  the  required  Iniormatlon  available?) 

A*  Student  description  (SD);    language*  background*  and  test-taking 
skills* 

Is  the  entering  language  skill  and  the  past  experience  of  the 
students  known?    Is  there  reason       expect  unusually  blgb  or  low 
scores  on  pre-  or  posttests? 

0  =  no  Information 

1  ■  Informal  observation  by  RMC,  or  brief  description  In  report 

2  ■  language^test  scores,  plus  some  Idea  of  testing  experience, 

previous  and  current-year  bilingual  Instruction,  and  bome 
language 

3  =  detailed  analysis  of  eacb  student 

B*  Comparison  standard  (CS) 

Is  tbe  estimate  of  bow  students  would  bave  scored  vltbout  tbe 
program  precise  In  relation  to  tbe  slz^  of  tbe  apparent  Impact  on 
test  scores? 

0  =  no  standard,  arbitrary  raw-score  gain  criteria,  etc* 

1  «  non**random  comparison  groups,  historical  data,  norms 

2  "  state-of-tbe-art  norms  plus  carefully  documented  local  compari- 

son groups 

3  »  multiple,  blgb  quality  comparisons 

C*  Curriculum  versus  test-content  match  (CH) 

Is  there  adequate  Information  on  bow  closely  the  test  cont:ent 
matched  the  bilingual-program  curriculum? 

0  «  no  Information  or  no  match 

1  -  test  can  be  assumed  to  be  reasonably  relevant  (standardized  . 

tests  qualify)  i 

2  =  relation  of  test  content  to  specific  curriculum  Is  known  at  a 

general  level 

3  =  detailed  Item-by-^ltem  analysis  related  to  detailed  subject 

iLitter  analysis 

D*  Test  adequacy  (TA) 

Are  tests  technically  adequate  In  terms  of  reliability,  and  floor 
or  celling  effects? 

0  =  no  Information,  or  obvious  major  flaws 

1  =  local  or  criterion-referenced  tests  without  careful  document 

tatlon  of  high  quality* 

2  ^  documented  reliability,  minimal  floor  or  celling  effects. 

(Major  standardized  tests  qualify* 

3  =  Carefully  documented  quality,  plus  detailed  Item  analysis,  ' 

etc.  I 


Figure  15.    RMC  credibility  rating  scales  for 
achievement  impact  evaluations* 
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I*  (continued) 


E*  Testing  and  scoring  procedures  (TP) 

Were  pre-  aud  postte^^t  administered  to  identical*  careful  stan- 
dards?   Is  error  rat     .n  the  data  acceptably  low? 

0  ■«  no  Information;  obvious  flaws 

1  *  good  report  from  site*  some  evidence  of  tester  training 

2  «  correct  testing  proce^^ires  observed  by  RMC  for  sample  of 

testers*    Data  appeal  to  be  In  order 

3  "  RMC  monitoring  of  all  testing*    KMC  monitoring  and  spot  check- 

ing of  data  recording 

II*  Data  Analysis  (DA)  (Have  the  data  been  misinterpreted?) 
Includes: 

•  Are  appropriate  scales  used  (e*g*t  HCEs*  no  GEs)? 

•  Are  students  grouped  by  language  skills? 

•  Are  only  students  with  both  pre-  and  posttest  score  Included? 

•  Are  dropouts  analyzed? 

•  Are  analysis  models  appri^rlate  snd  correctly  applied? 

0  «  raw  gainst  month-f or-month  gains*  no  grouping  students*  dropouts 

Included  in  pretest  means*  any  zeros  on  A-E 

1  «  appropriate  model  and  scale*  only  students  with  both  pre-  and 

posttests*  some  Indication  of  language  skills 

2  «  saice  as  'T'  plus  good  analysis  of  student  entering  skills  and 

background 

3  «  careful  documentation  of  all  of  ''2"  plus  floor  and  celling  ef- 

fects* matching  of  (Item)  scores  to  i  tstructlon*  etc* 

lit*  Interpretation  of  Results  (IR)  (^ere  the  results  due  to  the  bilingual 
project?) : 

A*  Rationale 

Was  there  a  logical  reason  to  expect  a  gain  or  loss  of  the  slza 
Indicated  by  the  results?    The  evaluation  literature  Is  full  of 
reports  of  draioatlc*  one-year  gains*  but  there  are  few*  If  any* 
validated  accounts  of  substantial*  long-term  upgrading  of  skills 
due  to  sped  i  programs*    This  Is  true  even  with  dramatically 
innovative  p  ograms  that  appear  to  the  trained  observer  to  be 
outstandingly  effective*    Thus*  large  gaius  In  generally  conven- 
tional programs  are  simply  not  credible  unless  they  persist  over 
year^*    The  burden  of  proof  is  on  the  exemplary  projact  to  show 
hov  instiuctlon  Is  different  from  (and  more  effective  than)  in^ 
ttruct.^oti  In  the  programs  of  hundreds  of  other  talented  and  dedi- 
cated educators*    Deterioration  of  p^^rformance  Is  more  common*  but 
apparent  losses  should  also  be  examlnea  'larefully* 


Figure  15  *  (continued) 
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III.  (continued) 


B.  Alternative  hypotheses 

Has  every  attempt  been  made  to  explore  and  rule  out  air  -native 
hypotheses  as  to  what  was  learned  and  why?    Most  local  reports 
seize  on  aay  positive  results  as  evidence  of  program  Impacts »  and 
make  no  effort  to  rule  out  possible  alternatives  that  ma^  be  much 
more  credible  than  are  program  Impacts.    Many  of  these  alterna- 
tive causes  are  included  In  the  areas  ll&ted  above.    Thla  area 
Includes  such  possible  explanations  as:     (a)  general  level  of 
ctudt.it  performance  In  the  school^  (b)  teaching  to  the  test  (which 
Is  a  form  of  learning,  but  one  that  distorts  the  meaning  of  evalu- 
ation results) »  (c)  school  changes  that  are  not  part  of  the  bilin- 
gual program,  and  (d)  programs  or  changes  outside  of  the  school. 

C.  Longitudinal  Impacts 

As  noted  under  "Rationale,"  a  one-year  evaluation,  especially  of  a 
new  program.  Is  never  highly  credible  as  an  Indicator  of  long-term 
Impact. 

Combined  ratings  for  Interpretation  of  Results  (IR): 

0  «  negligible  change  In  students^  learning  environment 

1  «  minor  changes  In  Instruction,  or  strong  rival  hypotheses 

2  =  substrantlal  changes  due  to  program,  and  no  obvious  alternative 

hypotheses 

3  ^  demonstrated  links  between  specific  skill  Improvements  and 

spec/€lc:  Instructional  treatments;  longitudinal  data  over 
several  years. 


Figure  15.  (continued) 
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11.2.2.3    Credibility  of  Interpretations.    The  final  category  covers 
the  credibility  of  Interpretations  of  the  results.    The  credibility  of  the 
analysis  provides  an  upper  limit  to  the  credibility  of  the  Interpretation 
but,  even  with  adequate  Information  and  appropriate  analyses,  an  evaluation 
was  judged  to  be  **not  credible*'  unless  a  reasonable  Interpretation  of  the 
results  vas  available. 

ljl.2.2.4    Scales  for  rating  credibility.    For  each  category,  a  four- 
point  credibility  rating  scale  was  defined  (Figure  14).    Although  the  scales 
were  unique  to  each  category,  they  all  were  Intended  to  reflect  the  follow- 
ing guidelines* 

0;    Evaluation  not  credible  due  to  Isck  of  Information  or  major  prob- 
lem In  this  category. 

1;    ProbletDS  In  this  category  could  quite  likely  obscure  a  sizable 
Impact  or  produce  a  substantlsl  artlfactusl  Impact  (&*g*»  ±10 
NCEs). 

2t    Moderately  convincing.    Unlikely  to  produce  artlfactual  effects 
as  large  as  +10  HCEs. 

3;    Highly  convincing.    Equivalent  to  a  well-executed,  laboratory 
experiment. 

11.2.3    Application       the  Credibility  Rating  Scales 

As  3C  .iid-year  evaluatlL.u  reports  were  received  from  i^e  sl*:es,  the 
Information  In  these  reports  was  combined  with  Informstlon  obtained  from 
RMC  slte-vlslts.    Credibility  ratings  were  assigned  by  two  evaluation 
specialists  working  together,  then  checked  with  a  member  of  the  relevant 
slte-vlslt  team.    In  addition,  eleven  sites  submitted  raw  data  or  detailed 
summary  data,  and  In  many  cases  RHC  was  able  to  Improve  credibility  ratings 
by  reanalyzing  or  reinterpreting  these  data.    In  several  cases,  s  consider- 
able amount  of  In-depth  reanalysls  was  carried  out.    The  evaluatlci.  rredl- 
blllty  ratings  In  four  subject  areas  (grade  2)  are  reported  for  ir     .jle  1 
for  all  fleXd-test  sites. 
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Table  1 

Credibility  of  Achievement  Impact  Evaluations 
1978^1979  Grade  2 


1.    EngUah  Pleading 
Site    SD    CS    CM    TA    TP    DA  IR' 

1  No  second-grad^  program 

2  No  report  received  by  RtiC 


2 

1* 

1* 

1* 

2* 

2* 

1 

1* 

6 

1 

1* 

2 

0 
'  * 

I* 

I 

1* 
1* 

2 

1* 

2* 

2* 
2* 
2* 

0 

1* 

1* 

0* 

1* 
1* 

7 

8 
9 

2* 
2* 
1* 

2 
1 
1 

1* 
1* 
1 

2* 
2* 

2 

2* 
2* 
2* 

1 
1 
1 

1 

1'' 
1* 

1  n 

11 

12 

2* 

2 

2* 

2 
1 
1 

1* 
1 

1* 

2* 
2* 

2 

2* 

2* 
2* 

1* 

),* 
1* 

i* 
I* 
1* 

13 
14 
15 

No  report  received  by  RMC 
1      1*    1*    2*    2*    1*  1* 

16 
17 

1* 
1 

2 
1 

1* 
1 

2 
0 

2 
1 

1 

0 

1 

0* 

18 
19 

No  report  received  by  KMC 
0      1      1*    2*    1      0*  0* 

Site 

SD 

3. 

CS 

,  Math'' 
CM  TA 

TP 

DA  , 

IR 

1 

2 
3 

1* 

1* 

]■■' 

2* 

1* 

1* 

1* 

4 

6 

1 

1* 

2 

0 

I* 

1* 

1* 
1* 

0 
1* 

2 

2* 
0* 
2* 

0 

0* 

1* 

0* 
0* 
1* 

7 

8 
9 

2* 
1* 
1 

2 
1 
1 

1* 
1* 

2 

2* 
2* 

2 

2* 
1* 
2* 

I 

1* 
1 

1 

1* 
1* 

10 

a 

12 

1* 

2 

1* 

2 
1 
1 

1* 

1 

1 

2 

2* 

2 

2* 
2* 
2* 

1* 
1* 
1* 

1* 
1* 
1* 

13 
14 
15 

1 

2* 

1* 

1 

1* 

1* 

1* 

16 
17 

1 
1 

2 
1 

I 
1 

2 
0 

2 
1 

1 

0 

I 

0* 

18 
19 

0 

1 

1* 

1 

1 

0* 

0* 

2*    Spanish/French  Reading 


Site 

SD 

CS 

ch 

TA 

TP 

DA 

IR 

1 

Z 

3 

1* 

1 

1* 

2* 

1* 

1* 

1* 

1 
1 

0 

1 
1 

1 

1" 

u 

c 

1  ^ 

1  ^ 

1 

1  'it 

1* 

1  ^ 

1  ^ 

£ 

0 

1 

0 

1^ 

1 

2* 

u 

7 

0 

1 
1 

i 

Z^ 

U 

8 

1* 

0 

1 

1 

1* 

0 

0* 

9 

1 
1 

1 

1 
1 

2 

2* 

1 

1* 

10 

1* 

0 

1* 

1 

1 

0 

0* 

11 

2 

1  o 

1^ 

0 

1 

0 

2* 

0 

0* 

13 

i 

I* 

1* 

1* 

1* 

1* 

1* 

15 

2 

0 

2 

1 

1 

0 

0* 

16 

1 

2 

1* 

2 

2 

I 

1 

17 

1 

1 

1 

0 

1 

0 

0*  . 

18 

19 

0 

1 

1* 

1* 

1 

0* 

0* 

4.  : 

English  Language  Proficiency 

Site 

SD 

CS 

CH 

TA 

TP 

DA 

IR 

1 

2 

3 

4 

5 

1* 

1 

1 

1 

1 

1 

1* 

6 

2 

1 

1* 

1* 

1 

0 

0* 

7 

o 

1* 

1 

1 

1 

1 

I 

1* 

9 

10 

11 

2 

1 

1* 

1* 

2 

0 

0* 

12 

13 

14 

1 

1 

1 

1 

1 

1* 

1* 

15 

2 

0 

1 

1 

I 

0 

P* 

16 

1 

1 

1 

1 

1 

1 

1* 

17 

18 
19 


*Ratlng  Is  based  on  Inf ormatl'^n  ^rom,  or  reanalysls  by,  RMC*    A  rating 
based  only  on  the  local  report  might  have  been  either  (a)  lower,  due  to 
missing  Information*  or  (b)  higher,  due  to  Inaccurate  information  In  the 
report. 

Column  headings  correspond  to  rating  scales  in  Figure  14. 
''Math  was  tested  in  primary  language  of  LEP  students  at  the  site. 
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11.2.3.1  "Impact-evaluation  credibility"  versus  "report  quality." 
Several  points  should  be  noted  when  reading  this  table.    Firsts  It  Is  the 
overall  credibility^  based  on  all  Information  available  to  RMC»  that  is 
reflected  In  the  ratings.    The  ratings  do  not  constitute  an  assessment  o£ 
the  quality  of  the  local  evaluation  reports.    However^  It  will  be  seen 
that  manjr  ratings  are  followed  by  asterisks »  indicating  that  the  reported 
Information  vas  Inadequate  or  misleading »  and  that  the  rating  Is  based  on 
additional  information  available"  to  RMC  rather  than  only  that  Included  In 
the  report. 

11.2.3.2  Second*Rrade  data.    The  ratings  In  the  table  refer  only  to 
seco  i-grade  evaluations.    While  the  second-grade  programs  were  new  during 
the  second  year  of  the  study^  we  believe  that  the  credibility  of  the  Im- 
pact evaluations  at  kindergarten  and  first  grade  Is  even  lower^  simply 
because  of  the  technical  problems  Involved  In  measuring  the  skills  of 
young  children. 

11.2.3.3  Site  codf  s.    The  sites  are  identified  simply  by  code  num- 
bers from  1  through  19.    In  the  Interests  of  anonymity^  these  numbers  were 
assigned  randomly  and  do  not  correspond  to  thz  ordering  of  site  reports  In 
Appendix  A.    While  all  of  the  f leld^test^slte  evaluations  Include  major 
def Iclencles^  It  would  be  Inappropriate  to  single  out  these  LEAs  for  crit- 
icism; firsts  because  many  of  the  problems  were  beyond  their  control^  and 
second^  because^  with  all  of  their  many  deficiencies »  these  19  evaluation 
reports  probably  exemplify  the  very  best  of  current  program  evaluations* 

11.2.3.4  Rating  levels.    Ho  ratings  of  "3"  (l.e.»  "highly  credible") 
were  assigned  in  any  category^  reflecting  the  fact  that  real-world  educa- 
tlor^l  evaluations  usually  leave  considerable  room  for  doubt.    Only  care- 
fully conducted  studies  with  consistent »  longitudinal  results  are  likely  to 
be  completely  convincing  In  a  school  setting.    On  the  other  hand»  there  are 
several  zeroes  In  the  tables.    In  general^  a  single  zero  Implies  that  the 
evaluation  provides  virtually  no  Information  as  to  the  amount  of  program 
Impact. 
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11.2.3.5    Sublectivity.    Finally^  It  iau3t  be  r.;-einphAsl2Cd  that  theae 
ratings  are  subjective  and  are  included  primarily  to  giv$  V     reader  a 
general  sense  of  trtiere  the  credibility  problems  l^y.    However^  while  any 
single  rating  may  be  legitimately  questioned^  we  belie.ve  that  the  overall 
picture  is  reasonably  accurate^  and  probably  applies  quite  well  most 
Current  educational  evaluations. 

11.2.4    Discussion  of  Credibility  Results 

This  discussion  describes  the  considerations  that  led  to  the  cradi-^ 
bility  ratings  for  second-grade  English  reading  (Table  1).  In  general^ 
math  ratings  were  simijar.    Spanish  and  French  readings  and  English- 
language-*prof iciency  impact  evaluations  were  generally  less  credible^  due 
to  the  additional  difficulties  in  finding  appropriate  tests  and  compari- 
son groups  and  the  consequently  limited  effort  allocated  to  evaluating 
these  subject  areas  in  most  sites. 

•  Student  description:    Only  three  sites  both  (a)  provided  language- 
test  scores  and  (b)  made  a  serious  attempt  to  provide  infonnation 
on  previous  student  experience.    Of  the  remainder^  some  provided 
language"test  scores  and  others  provided  virtually  no  Information 
at  all.    In  most  cases^  a  credibility  of  "1"  (rather  than  "0") 
could  be  assigned  based  on  the  observation  of  the  students  by  RMC 
site  visit  teams. 

•  Comparison  standards;    Most  sites  were  givun  credit  for  "Is" 
because  they  used  tests  with  national  norms.    In  several  cases^ 
the  norms  were  not  used  in  the  reports  and  were  supplied  by  RMC 
(see  asterisks)*    Two  sites  had  both  national  norms  and  compari" 
son  classrooms  (observed  by  RMC  staff).    Based  on  these  coispari- 
son  classrooms^  a  credibility  -ating  of  *'2"  was  assigned.  One 
site  reported  only  pretest  and  posttest  raw  scores  usj.ng  a  test 
that  did  not  have  conventional  nonaative  data. 
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•  Test-^content  match*    Only  a  few  sites  reported  any  attempts  to 
compare  test  content  to  curricula*    The  ratings  of  "1**'  reflect 
BMC's  judgment  that  the  standardized  tests  used  In  most  sites 
were  at  least  generally  relevant  to  the  Impact  question* 

•  Test  technical  adequacy*    The  standardized  English  reading  and 
math  tests  are  usually  of  adequate  technical  quality*    in  most 
sites »  the  levels  were  appropriate  for  the  second-grade  students 
and  floor  or  celling  effects  were  minimal*    Problems  with  other 
tests  varied  from  site  to  site*    Few  sites  discussed  these  Issuea 
at  all  and  only  one  in  any  detail* 

•  Testing  and  scoring  procedures*    Based  on  RMC  observations*  It 
did  not  appear  that  major  problems  were  Introduced  by  Improper 
testing  or  scoring*    The  ratings  of  "2»*'  however*  may  be  gener-* 
ous  for  some  sites* 

•  Data  snalysls:    Ratings  were  limited  to  "1"  or  lower  by  the 
comparlson-stanjards  problems*    However*  even  these  ratings 
were  based  on  BMC  reanalysls  for  most  sites*  since  only  a  few 
sites  reported  gains  In  any  meaningful  metric  (l*e*»  standard 
scores  or  percentiles)* 

•  Interpretation*    Only  three  of  the  reports  Included  adequate 
Interpretations  of  results,  and  In  two  of  these  sites  the  inter- 
pretations consisted  primsrlly  of  Insightful  discussions  of  the 
problems  that  precluded  credible  Impact  evaluation  during  the 
first  two  years  of  program  Implementation*    All  other  ratings  in 
this  column  are  based  on  BMC  observations  of  the  programs  and  the 
contexts*    The  limiting  factor  was,  of  course,  the  lack  of  Infor- 
mation under  the  first  five  categories* 

Overall,  the  credibility  of  the  Impact  evaluations  was  consistently 
low*    Only  one  site  (number  16}  presented  somewhat  convincing  results* 
In  this  site,  there  was  substantial  evidence  that  the  bilingual  programs 
ware  having  a  positive  Impact  on  student  achievement*    The  major  area  of 
uncertainty  was  whether  the  PIP  had  had  a  real  Inpact*    Because  this  site 
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had  had  bilingual  instruction  prior  to  the  PIP  diffusion  effort,  there  was 
no  way  for  the  evaluator  to  isolate  the  effects  of  the  PIP  from  those  of 
the  preexisting  bilingual  program  practices. 

In  the  remaining  18  sites,  there  was  no  basis  for  either  positive  or 
negative  conclusions  concerning  PIP  impacts  on  achievement.    Many  of  these 
sites  did,  however,  provide  data  that  suggested  that  students  in  the  bi-- 
lingual  programs  were  making  substantial  achievement  gains,  and  that  some 
o£  these  were  performing  very  well.    While  these  data  do  not  bear  directly 
on  the  questions  addressed  in  this  study^  they  are  summarised  in  Appendix 
D  for  those  readers  who  may  be  interested. 

1 1 » 2 . 5    The  Quality  of  Local  Evaluation  Reports 

11^2.5.1    Frequently  encountered  problems.    The  comments  above  per- 
tain only  to  the  credibility  of  the  evidence  available  to  BtMC  bearing  on 
PIP  impact.    This  evidence  included  the  local  evaluation  reports,  data 
supplied  to  RMC  by  the  sites,  and  information  obtained  by  RMC  on  site 
visits.    Where  impact  evaluations  were  given  low  credibility  ratings,  this 
meant  that  the  efforts  of  RMC  plus  the  local  evaluators  vere  insufficient 
to  isolate  the  impacts  of  the  PIPs  from  other  factors  that  influence  test 
scores.    In  a  few  cases,  the  credibility  of  the  impact  evaluations  was  low, 
even  though  the  quality  of  the  evaluation  reports  was  judged  by  RMC  to  be 
excellent. 

There  is  no  contradiction  in  this  discrepancy,  because  the  achie^'e- 
ment  impact  question  was  only  one  of  many  considerations  in  the  reports 
and  ic  was  probably  the  most  difficult  of  all  to  answer.    Evaluation  re- 
ports serve  a  variety  of  purposes  (e.g.,  compliance  with  Federal  regula- 
tions, auditing,  reporti£^g  to  LEA  decision  makers  and  school  boards)  and 
may  influence  the  dc'.velopment  of  recommendations  for  program  ch^inges. 
Many  of  the  reports  provided  documentation  of  staff  development,  parent 
Involvement,  and  some  description  of  program  implementation,  and  dius^ 
would  be  useful  for  some  of  the  above  purposes.    However,  ^ith  three  no- 
table exc^eptions,  these  reports,  like  moFV  LEA  e/aluation  reports,  were 
incomplete  and/or  misleading  to  the  extent  that  they  w^re  inadequate 
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for  any  achievement-outcome  evaluation  purpose^  performance-level  assess- 
ment as  ttell  as  impact  measurement. 

One  of  the  exceptional  reports  described  a  well-reasoned  design  and 
analysis  that  did  provide  some  evidence  on  achievement  impacts.    A  second 
reflected  an  exemplary^  longitudinal  design  that  should  provide  impact 
evidence »  as  well  as  other  locally  useful  information  in  future  years » 
although  data  were  not  available  in  time  for  inclusion  in  thla  report. 
The  third  provided  an  excellent  analysis  and  discussion  of  the  evaluation 
issues  and  problems^  but  problems  beyond  the  control  of  the 
precluded  any  impact  evidence.    Two  additional  reports  showet  .worthy 
attempts  to  establish  appropriate  designs  that  may  well  produce  valuable 
information  in  future  years. 

Problems  among  the  remaining  reports  included  incomplete  information 
about*-- (a)  student  characteristics »  (b)  nunibers  of  students^  and  (c)  tests 
and  levels  in  use.    Many  reports  also  used  inappropriate  scales  such  as 
grade-equivalent  scores^  and  inappropriate  evaluation  models — for  example^ 
simply  taking  the  raw  gain  from  pretest  to  posttest  as  evidence  of  a  proj- 
ect effect  (Horst^  Tallmad^e^  and  Woud»  1975).    In  f act »  some  reports  re- 
flected major  problems  in  every  one  of  the  seven  areas  discussed  in  Section 
11.2.2. 

These  problems^  however^  are  not  peculiar  to  the  19  field-test  sites 
or  to  bilingual-program  evaluations.    In  fact>  in  our  experience >  they  are 
typical  of  all  local  evaluations  of  all  types  of  programs »  whether  conducted 
by  ISA  ejaluators  or  outside  consultants.    We  uere  aomewhat  surprised  by 
the  deficiencies  in  these  reports,  because  ue  had  known  and  worked  with  the 
evaluatoi's  for  two  years^  and  knew  most  of  them  to  be  highly  cod  petctnt 
nrufeasionalo.    Tn  addition^  KMC  had  provided  guidelines  that»  if  followed^ 
would  have  eliminated  many  of  the  problems  with  the  reports.    The  question 
iS"-Vhat  accounts  for  the  deficiencies  in  these  (and  most  other)  LEA  eval- 
uation reports? 

11.2.5.2    Possible  reasons  for  evaluation-report  deficiencies.  In 
spec!;^ating  as  to  the  answer^  it  is  essential  to  keep  two  key  points  in 
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mind:    First,  the  quality  of  these  reports  is  no  worse  than  average.  The 
quality  of  most  evaluation  reports  Is  low.    This  is  not  a  problem  of 
bilingual  education  or  of  these  19  LEAs.    Second,  the  evaluators  In  most 
of  these  sites  were  highly  skilled.    In  many  cases,  it  is  safe  to  assume 
that  they  knew  and  understood  the  weaknesses  of  the  reports. 

In  some  sites,  there  were  obvious  reasons  for  the  problems  (e.g.,  the 
evaluators  resigning  before  the  reports  were  completed).    In  most  cases, 
however,  we  believe  that  the  reasons  were  of  a  different  kind,  and  that 
they  have  profound  Implications  for  the  evaluation  of  all  kinds  of  federally 
funded  education  programs.    We  believe  that  at  least  three  factors  are 
Involved: 

•  Lack  of  evaluator  time.    Most  evaluators  had  only  a  few  days 
to  do  tasks  that  would  require  weeks  to  complete  properly. 
There  appears  to  be  a  basic  lack  of  understanding  of  the  com^ 
plexlty  of  evaluation  tasks  on  the  part  of  local  and  fundings 
agency  personnel. 

•  Conflicting »  Inappropriate  and  Impossible  demands.    Local,  fed" 
eral,  and  other  regulations  are  often  conflicting.    In  addition, 
these  regulations  may  call  for  Inappropriate  procedures  (e.g., 
grade  equivalents)  or  set  unrealistic  goals  (&*g*»  Impact  evalu* 
ation).    Consequently,  the  evaluator  Is  often  faced  with  a  task 
that  could  not  be  done  correctly*  even  If  the  time  were  available. 

•  Non-use  of  reports  by  funding  agencies.    Site  personnel  have  no 
Indication  that  their  reports  are  carefully  read  or  that  the  re*^ 
suits  are  used  for  decision-making  purposes  by  the  agencies  re*^ 
questing  the  reports. 

In  summary,  it  Is  not  surprising  that  the  local  evaluator,  frustrated 
by  lack  of  time  and  Impossible  demands,  and  reasonably  certain  that  the 
report  will  go  unread  by  any  critical*  technically  sophisticated  audience, 
produces  reports  that  are  less  than  adequate. 
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12.    EVALUATIOH  OF  OTHER  IMPACTS 


12.1  Introduction 

The  second  objective  In  the  RFP  for  the  blllngual-PIP  field-test 
study  was  to  "determine  the  effectiveness  of  projects  Implemented  via  the 
PIPs  In  Improving  student  achievement  and  attitude"  (Section  4.1).  While 
Sections  9^11  address  Impact  on  achievement »  this  section  deals  with  the 
evaluation  of  other  program  goals.    The  majority  of  bilingual  projects 
have  established  goals  for  staff  development »  and  community  Involvement 
as  well  as  for  student  affective  growth.    For  this  reason^  RMC  staff  chose 
to  broaden  the  study  question  to  Include  these  three  major  areas. 

BMC's  role»  as  stated  above^  was  to  provide  consulting  help  to  all 
fleld*test  sites.    BMC  wss  then  to  utilize  the  evaluations  conducted  by 
esch  of  the  field  test^sltes  for  purposes  of  the  PIP  study.    After  the 
flrst^year  evaluations  were  completed^  RMC  staff  reviewed  all  available 
reports.    In  addition  to  reviewing  achievement  evaluation  procedures^  the 
staff  reviewed  and  analyzed  procedures  used  for  evaluating  student  sffec- 
tlve  growth^  and  the  staff  development  and  parent /community  Involvement 
components.    The  staff  also  reviewed  the  current  literature  relevant  to 
these  areas. 

For  each  area  a  summary  of  evaluation  methods  used  by  sites  was  pre^ 
pared^  as  well  as  a  discussion  of  technical  Issues^  and  a  list  of  recom^ 
mendatlons.    These  materials  were  sent  to  all  of  the  field-test  sites  In 
order  to  encourage  the  sites  to  evaluate  goals  other  than  student  achieve- 
ment goals  and  to  use  measures  other  than  achievement  tests. 

Specific  results  In  these  areas  are  not  reported  for  several  reasons. 
Some  sites  did  not  address  these  Isues^  or  did  so  at  a  minimal  level.  For 
those  that  did  address  these  Issues^  the  evaluation  procedures  were  gener^ 
all^  at  a  developmental  stage.  Evaluation  procedures  and  methods  varied 
widely  across  sites.  Descriptive  techniques  were  most  often  employed^  and 
when  pre^post  measures  were  used  It  was  not  usually  possible  to  determine 
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the  role  of  the  bilingual  project  In  producing  the  change*    So,  while  the 
sites  were  employing  standard  procedures  in  these  areas  and  evaluators 
were  probably  devoting  as  much  time  to  these  areas  as  funds  would  allow, 
the  amount  and  type  of  data  presented  In  the  reports  did  not  Justify  a  de- 
tailed summary  of  results* 

This  section  Is  divided  Into  three  sections i 

•  evaluation  of  affective  Impacts 

•  evaluation  of  staff  development 

•  evaluation  of  parent/community  Involvement 

Each  section  consists  of  two  major  parts;    <1)  a  brief  discussion  of  some 
of  the  technical  Issues  involved  In  evaluating  the  area  of  concern,  and 
(2)  a  summary  of  practices  employed  by  the  field-test  sites*    The  recow** 
mendatlons  that  were  sent  to  sites  can  be  found  In  Volume  III,  Appendix  B* 
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12*2    Evaluation  of  Affective  Impacts 


12*2.1    Technic si  Issues 

12.2.1.1    Specification  of  Rosls.    Measuring  benefits  to  students  In 
the  affective  domsln  Is  difficult  for  s  number  of  reasons*    First,  the 
gosls  In  the  affective  domsln  sre  often  brosd  snd  vsgue*    For  exsmple,  the 
goal  of  Improving  eelf-concept  Is  open  to  many  Interpretations.    It  Is  a 
controversial  gosl,  ss  well,  since  It  Is  not  clesr  that  bilingual-program 
students  necessarily  have  low  self-coitcepts,  nor  Is  It  clear  that  there 
Is  s  causal  relationship  between  self-^concept  and  achievement*    This  goal 
might  be  made  more  specific  snd  more  managesble  by  bresklng  It  down  Into 
various  components.    A  progrsm  might  set  a  gosl  that  students  In  the 
blllRgusl  program  will  Improve  their  opinions  of  themselves  as  successful 
resders,  for  example,  or  as  successful  math  students. 

Most  bilingual  projects  have  explicit  goals  for  student  affective 
growth*    A  review  of  flrst-yesr  evaluation  reports  from  the  bilingual 
fleld^t est -site  programs  revealed  thst  the  most  common  goals  for  student 
sffectlve  growths  were  to: 

•  Increase  awareness  of  and  appreciation  for  the  child's  own 
culture  and  the  dominant  culture* 

•  Improve  aelf '^concept . 

12.2*1.2    Causea  of  affective  changes.    Secondly,  It  1?  not  clearly 
ststed  In  most  proposals  or  evsluatlon  reports  precisely  how  project 
features  are  expected  to  bring  about  chsnges  In  student  attitudes.  In 
Some  projects  It  Is  expected  that  self-concept:  wilt  Improve  "through  an 
understanding  of  the  cultural  heritage  of  both  languages"  (Vencereioos, 
Project  Management  Directory,  p.  86)*    For  the  other  projects  It  Is  Im- 
plied that  Improved  attitudes  toward  self  snd  others  sre  expected  to  be 
a  result  of  one  or  more  of  the  following:    (1)  accepting  and  using  the 
language'of  the  child;  (2)  providing  successful  learning  experiences;  (3) 
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Integrating  the  culture  of  the  child  Into  the  curriculum;  (4)  Involving 
parents  In  classroom  and  other  activities;  and  (5)  employing  bilingual, 
blcultural  teachers  who  serve  as  role  models.    Mbre  generally,  It  Is 
Implied  that  the  project  as  a  whole  will  bring  about  affective  changes 
In  students. 

Many  sites  measured  one  chosen  aspect  of  student  attitudes  and  re*^ 
ported  the  results  without  providing  a  discussion  of  the  possible  reasons 
for  the  results.    If  Improvements  are  expected  to  be  due  to  one  of  the 
project  features  mentioned  above,  then  a  crucial  step  must  be  to  state 
whether  that  particular  project  feature  was  Implemented.    For  example,  if 
Venceremos  sites  exp<^cted  the  cultural  component  to  Influence  student  self*- 
concept,  then  It  would  be  necessary  to  describe  the  nature  and  extent  of 
the  cultural  component  that  was  a'^tually  Implemented,    if  there  was  no 
cultural  component  Implemented,  or  If  It  was  very  minimal,  then  there  Is 
no  reason  to  expect  that  It  affected  self-concept.    Likewise,  If  Improved 
self-concept  Is  expected  to  be  a  result  of  the  Introduction  of  concepts 
In  the  native  language,  at*d  the  latter  did  not  occur,  there  Is  no  reason 
to  expect  to  achieve  the  affective  objective.    Therefore,  sites  should 
report,  to  the  extent  possible,  which  project  features,  or  combination  of 
features,  were  expected  to  produce  affective  changes.    They  should  then 
discuss  to  what  degree  those  features  were  Implemented.    If  they  were 
not  Implemented,  or  were  Improperly  Implemented,  then  It  is  not  possible 
to  attribute  changes  ixt  student  affective  charf^ct^rlstlcs  to  those  fea*" 
tures. 

12.2.1.3    Impacts  of  meaningful  instruction.    The  very  nature  of  a 
bilingual  project  makes  It  different  from  other  types  of  special  projects 
In  one  Important  way.    In  most  special  projects.  It  Is  d!3Sumed  that  the 
normal  treatment  Is  meaningful  to  the  students,  at  least  In  the  sense  that 
they  can  comprehend  the  language  used  In  Instruction,  but  that  the  special 
project  provides  a  better  method  of  teaching.    The  situation  Is  dlf fere'it 
In  a  bilingual  program.    The  normal,  all*^Engllsh  prograst  cannot  be  "mean- 
ingful" (in  the  sense  of  the  Lau  decision)  If  children  are  not  yet  fluent 
speakers  of  English.    Instruction  Is  meaningful  to  chlloren  only  to  the 
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extent  that  they  can  understand  what  is  said  to  them  and  participate  In 
verbal  exchanges  with  teachers  and  other  students  throughout  the  day. 


For  this  reason*  the  first  question  that  needs  to  be  addressed  b^ 
districts  In  evaluating  effects  of  the  project  on  students  Is;    To  what 
extent  are  students  receiving  meaningful  Instruction?    This  question  can 
be  broken  down  Into  other  questions  such  as;    To  what  extent  can  teachers 
and  children  communicate  with  one  another?    What  proportion  of  the  day  Is 
meaningful  to  children  In  terms  of  the  degree  to  which  they  speak  and 
comprehend  the  language  of  Instruction?    To  what  extent  are  children  able 
to  relate  to  and  profit  from  the  Instructional  materials?    These  are  com- 
plex questions  due  to  the  range  of  language  proficiency  levels  of  children 
and  the  Inadequacy  of  measurement  techniques.    Nevertheless,  these  Imme- 
diate benefits  to  children  should  be  addressed,  since,  although  the  affec- 
tive Impacts  appear  obvious  to  bilingual  educators,  they  are  not  always 
recognized  by  others.    In  addition,  while  the  long-range  effects  of  such 
Instruction  should  show  up  In  achievement  test  scores,  this  Is  not  always 
the  case  due  to  short*range  evaluation  designs,  high  levels  of  student 
turnover,  and  a  variety  of  other  factors. 

12.2.2    Affective  Evaluation  Methods 

Evaluating  affective  changes  Is  problematic  since  It  Is  Impossible  to 
measure  attitudes  directly.    Since  an  attitude  Is  a  hypothetical  construct 
generally  considered  to  be  composed  of  feelings,  behaviors,  and  knowledge 
or  beliefs.  It  Is  necessary  to  choose  possible  Indicators  of  an  attitude, 
measure  these,  and  make  Inferences  about  the  attitude.    There  Is  a  variety 
of  ways  In  which  a  district  can  describe  project  benefits  to  students  (see 
Volume  III>  Appendix  B)*    The  number  of  approaches  used  and  the  extent  of 
their  use  will  depend,  of  course,  on  time  and  financial  constraints. 

Sites  ^hat  used  affective  measures  made  an  attempt  to  locate  the  best 
measures  available,  but  the  choice  of  adequate  measures  (particularly  In 
two  languages)  Is  very  limited.    Host  sites  used  paper*^and-pencll ,  self- 
report  Instruments  or  teacher  rating  scales.    Self-report  Instruments  are 


very  unreliable  for  young  children  since  snclal  desirability  and  events  of 
the  moment  have  a  great  Influence  on  responses.    Teacher  rating  scales  are 
more  likely  to  be  reliable*  particularly  If  several  ineasures  are  taken 
longitudinally.    A  variety  of  unobtrusive  measures  can  also  be  used. 

One  site  administered  an  affective  test  but  did  not  report  results* 
stating  that  the  test  was  not  valid  and  reliable.    Another  alte  reported 
results  of  a  locally  developed  ineasure*  but  discounted  the  results  for 
similar  reasons.    For  future  yeara>  If  the  reliability  and  validity  of 
locally  developed  tests  are  unknown*  theae  parameters  ahould  be  Investi- 
gated.   If  this  Is  not  poaslblet  then  It  might  be  better  to  choose  com- 
mercially available  Inatruments  that  are  technically  more  adequate. 

A  number  of  sites  that  had  stated  affective  goals  employed  no  measures 
and  reported  no  results  In  this  area.  Of  those  sites  that  did  address  stu- 
dent affect)  the  most  common  approaches  were  the  following: 

•  paper-and^encll >  self-report  measures  of  sel£-concept>  adminis- 
tered pre  and  post; 

•  paper-and*pencll»  self-report  measures  of  cultural  attitudes* 
administered  pre  and  poat; 

•  documentation  of  classroom  and  outside  cultural  activities 
offered  by  project; 

•  reporting  the  percentage  of  students  who  patldpated  In  a 
given  number  of  cultural  events  In  the  clasaroom. 

Other  approaches  use<!  by  at  least  one  site  were: 

•  teacher  rating  scale  to  assess  students^  loclal  behavior; 

•  teacher  rating  scale  to  asseas  etudents"^  school- related 
behavior  and  attitudes; 
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teacher  rating  scale  to  assess  student  attitude  tof/ard  self  as  a 
bilingual  and  tof/ard  others  as  bilinguals; 

teacher  rating  scale  to  assess  students'  participation  in  class- 
room and  playground; 

paper*-and^pencil»  self-report  measures  of  attitude  toward  school 
and  toward  school  subjects »  administered  3^4  times  during  year. 
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12*  3    EvaluaClon  of  SCaff  DevelopmenC 


12*3*1    Technical  Issues 

12*3*1*1    Primary  scaf f^developmenc  goals*    The  staff  developioenc 
component  can  be  evaluated  through  a  variety  of  approaches  depending  on 
(a)  who  or  what  Is  evaluated »  (b)  which  specific  qualities  or  characteris- 
tics are  being  assessed^  and  (c)  how  much  time  Is  Involved*    In  practice^ 
most  evaluations  address  only  the  content  of  the  pre**  or  In-servlce  ses- 
sions »  but  to  assess  the  value  of  a  staff  development  program  adequately^ 
the  effects  of  training  sessions  on  Instructional* staff  performance  must 
also  be  examined*    The  general  goal  o£  staff  development  Is  to  Improve 
the  teachers'  and  aides'  performance  In  bilingual  Instruction,,  and  the 
results  can  be  assessed  by  answering  the  following  questions:    How  has 
classroom  performance  changed?    How  have  knowledge*  skills »  and  attitudes 
changed?    and  How  have  language  skills  ijoproved?    An  adequate  evaluation 
should  try  to  answer  all  of  these  questions* 

The  ultimate  benefit  of  a  staff  development  component  should  be  Its 
effects  on  the  quality  of  the  studsnts'  education*    It  Is  difficult  to 
measure  effects  on  students  and  to  be  able  to  attribute  them  to  training 
sessions^  but»  In  some  cases»  districts  may  be  able  to  do  this*    If»  for 
example^  teachers  attend  a  session  on  "Cooperation  In  Learning  Centers/' 
an  observer  should  be  able  to  document  the  extent  to  which  there  Is  a 
change  In  this  kind  of  student  behavior  over  time  using  a  simple  observa- 
tion Instrument* 

12*3*1*2    Other  staff -^development  outcomes*    In  addition  to  assessing 
effects  on  teachers^  aldes»  and  students^  It  Is  possible  to  evaluate  p_voz 
ducts  produced  during^  or  ^s  a  result  of»  training  sessions*    If  part  of 
the  Inservlce  program  Involves  materials  development^  then  the  resulting 
materials  can  be  listed^  described^  and  evaluated  In  terms  of  their  rele^ 
vance»  usefulness^  and  other  features* 
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Another  goal  that  has  been  receiving  increased  emphasis  is  the  up-» 
grading  of  management  and  evaluation  skills  for  program  staff.    Sites  may 
choose  to  evaluate  management  and  esraluation  componencs  in  oider  to  pro-» 
vide  useful  information  to  improve  next  year's  program. 

The  term  "staff^'  can  be  defined  as  project  staff*  or  more  broadly  as 
all  district  staff*  or  even  more  broadly  as  staff  from  other  districts. 
If  non*proiect  staff  are  included  in  in-service  sessions,  or  if  they  re- 
ceive information  about  the  project*  then  the  effects  of  these  efforts 
can  be  evaluated  and  discussed.    If  the  practices  employed  by  the  project 
are  so  innovative  or  successful  that  they  are  influencing  neighboring 
districts*  then  this  is  an  important  benefit  of  the  project. 

The  time  frame  for  evaluating  the  staff  development  component  can  be 
viewed  in  several  ways.    The  content  of  a  workshop,  or  teacher  performance 
in  the  classroom  can  be  evaluated  for  each  workshop.    Another  approach  is 
to  look  at  changes  occuring  from  fall  to  spring,  or  from  year  to  year  or 
cumulatively,  over  the  entire  length  of  the  project. 

12.3.2    Staff*Development  Evaluation  Methods 

A  review  of  evaluation  reports  from  bilingual  pip  field-test  sites 
indicated  that  the  most  common  approach  to  the  evaluation  of  the  staff 
development  component  was  to: 

•  provide  description  and /or  documentation  of  workshops  and  other 
training  activities  that  have  been  provided. 

•  evaluatfi  the  content  o£  the  training  activities. 

The  description  of  workshops  and  other  activities  usually  consisted  of 
a  list  and  some  sample  outlines  of  presentations.    In  order  to  evaluate 
the  content  of  the  sessions,  most  sites  had  workshop  participants  fill 
out  a  combination  rating  form/ questionnaire  in  which  they  evaluated 
sessions  iti  terms  of  criteria  such  as  expertise  of  presentor,  relevancy. 
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clarity*  pxacticality »  meeting  stated  objectives*  and  meeting  needs^r  The 
results  o£  these  evaluations  were  summarized  across  participants  and  often 
actusl  comments  made  by  participants  were  included  in  the  summary*  Sev- 
eral such  summary  sheers»  representing  several  workshops*  were  generally 
included  in  an  appendix  as  examples «    The  results  were  then  summarized 
across  several  or  all  sessions  £or  the  year  and  the  conclusion  reached  was 
often  something  like  "With  one  exception*  all  workshops  met  their  objec- 
tives and  provided  useful*  practical  information  for  teachers*"   The  ma- 
jority of  sites  evaluated  their  stsff  development  component  at  this  level* 

A  number  of  sitee  employed  additional  techniques*  including  the  fol-* 
lowing: 

«     a  needs  assessment  administered  in  the  fall* 

•  pre-*  and  posttests  on  content  of  workshop  administered  to  par* 
ticipants  at  each  workshop* 

•  classroom  observation* 
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12.4    Evaluation  of  Parent/Connminlty  Involvement 


12.4.1    Technical  Issues 

12.4.1.1    Context .    To  a  large  extent^  the  success  or  failure  of  a 
program  Is  detemdned  by  the  contextual  features  thst  characterize  It* 
Parent/community  (P/C)  support  of  a  blllngusl  education  program  can  be  a 
great  asset  throughout  program  Implementation  and  operation.    For  ttils 
reason*  It  Is  important  to  document  and  report  the  type  of  community  sup"* 
port  a  program  receives  throughout  the  various  stages  of  program  develop-^ 
ment  (planning  stage»  Implementation).    The  amount  of  Bu)>port  a  program 
receives  Initially  can  be  a  predictor  of  the  type  of  support  It  will  re- 
ceive throu^out  Its  llfe^  unless  some  community  features  change  dramatl** 
cally.    Once  the  schools  where  the  program  will  be  housed  are  selected* 
some  historical  data  should  be  collected  to  document  the  extent  of  p/C 
support  that  existed  prior  to  the  program's  Inception.    This  Information 
can  be  used  as  a  comparison  In  documenting  the  change  In  community  support 
over  time. 

12.4*1*2    Objectives.    A  second  Important  stpp  Is  to  develop  realls** 
tlC|  meaningful^  short-term  and  long-'term  objectives  which  vlll  define 
the  expected  school-^communlty  relationship.    P/C  participation  In  setting 
these  objectives  Is  essential^  since  It  will  outline  the  P/C  commitment 
to  the  school  as  well  as  their  exj^ectatlons  of  the  school.    It  Is  essen- 
tial to  ensure  that  minority  P/C  participation  will  occur*  since  this  Is 
the  target  population  of  the  bilingual  education  project  and  since  com- 
pliance with  federal  guidelines  Is  a  goal  In  Itself. 

12.4.1.3    Activities.    A  third  step  Is  to  plan  processes  and  actlvl* 
tlea  that  will  produce  the  desired  outcomes  specified  In  the  goals.  The 
formation  of  a  PAC»  production  of  an  activities  calendar »  and  formation 
of  standing  committees  (for  hiring^  curriculum*  evaluation*  etc.)  are 
exsmplea  of  processes  that  will  achieve  some  of  the  short*-term  goals  spe*- 
clfled.    Parents'  actual  participation  In  the  classroom^  and  preparation 
of  cultural  Instructional  units  by  parents^  are  examples  of  activities 
that  may  contribute  to  achieving  some  of  the  desired  long*-term  goals. 
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A  fourth  step  Is  one  that  was  addressed  by  most  fleld-^test  sites* 
Thla  Is  to  document  the  array  of  actlvltlaa  that  take  place  throughout 
the  school  year  and  are  of  significance  to  the  school*comniunlty  marriage* 

12*4*2    Parent /Gomntunlty  Evaluation  Methods 

A  review  of  the  fleld**test  altes"^  evaluation  reports  showed  that  the 
moat  common  approach  to  evaluating  the  community  component  was  documenta- 
tion of  events*  Whether  or  not  changes  came  about  because  of  parent/com*< 
munlty  participation  was  often  not  addressed*  In  most  reports*  little  or 
no  attention  was  given  to  examining  the  effects  of  this  component  on  the 
schoolc»  the  students,  or  the  communities  themselves*  The  following  eval 
uatlon  approachea  were  by  far  the  most  common: 

•  reporting  attendance  at  parent  advisory  committee  (PAG)  meetings 
presenting  minutes,  and  listing  accomplishments; 

•  describing  parent  workshops  and  parent  education  seaslons,  and 
reporting  attendance; 

4     documenting  efforta  to  disseminate  Information  about  the  school 
and  the  project  to  parents  and  community; 

•  documenting  home  visits  by  staff  and  parent/teacher  conferences* 

A  limited  number  of  sites  employed  additional  evaluation  techniques. 
Including  the  following: 

•  using  a  pre^post  questionnaire  to  measure  parents^  gains  In 
knowledge  of  bilingual  education,  and  attitudes  toward  tha 
program; 

•  documenting  parent  activities  In  the  school  (as  tutors,  fleld^ 
trip  supervisors*  etc*}; 
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Hating  products  of  psrent/community  workshops  (instructional 
games,  cassette  recordings,  newsletter,  etc.); 

administering  parent  questionnaires  to  a&sess  parents'  perceived 
value  of  their  participation  in  school  activities; 

administering  parent  questionnaires  Lo  sssess  whether  or  not 
information  was  received  about  the  projects  and  about  project 
evaluation; 

administering  a  questionnaire  addressed  to  the  PAC  to  assess 
strengths  and  weaknesses  of  the  bilingual*education  project; 

conducting  a  survey  to  assess  child's  home  language  use. 
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13*    CONCLUSIONS,  RECOHHBNDATIONS^  AND  PRODUCTS 
PROM  THE  IMPACT  SOBSTODY 


13* I    Apparent  Impact  as  a  Criterion,  for 
Selecting  Exemplary  Projects 

The  first  conclusion  to  be  drawn  from  the  Impact  Substudy  is  that 
the  apparent  impact  of  a  project  on  student  achievement  is  not  a  suffi- 
cient criterion  for  selecting  projects  or  practices  (bilingual  or  other) 
for  diffusion*    The  study  reemphasized  the  finding  from  previous  PIP 
studies  that  apparent  Impacts  of  exemplary  projects  are  confounded  with 
factors  related  to  the  contexts  in  which  the  projects  operate*  and  with 
problems  in  the  impact  evsluations*    F\irther»  even  if  legitimate  impacts 
attributable  to  a  project  could  be  demonstrated »  the  project  features  may 
not  appeal  to  target  LEAs* 

In  lieu  of  demonsf;rable  Impacts  on  student  achievement^  it  seems 
reasonable  to  identify  projects  and  practices  that  are  judged  especially 
effective  by  the  teachers  and  other  personnel  involved »  and  to  disseminate 
information    Dout  these  projects  and  practices  to  target  LEAs*  However^ 
the  experience  of  the  PIP  studies  and  other  diffusion  studies  is  that  (a) 
it  is  very  difficult  and  costly  to  get  target  LEAs  to  replicate  exemplary 
projects  closely^  and  (b)  given  the  characteristics  of  most  exemplary 
projects^  there  is  no  justification  for  requiring  replication*    (In  some 
esses  I  it  seems  clear  that  replication  of  certain  features  would  be  harm** 
ful*}    Before  deciding  that  a  specific  project  or  practice  is  of  sufficient 
value  to  justify  accurate  replication  (and  the  expense  of  the  diffusion 
system  required  to  obtain  accurate  replications) »  the  value  of  the  project 
or  practice  should  be  confirmed  through  a  program  of  rigorous  research* 

In  shorty  it  is  reasonable  to  select  for  dissemination  any  ideas  that 
may  be  of  use  or  intereat  to  educators^  provided  that  the  cost  of  dissemi- 
nation is  not  too  high*    By  contrast*  the  cost  of  an  effective  diffusion 
system  will  almost  certainly  be  high*    Perhaps  of  even  more  concern  ifi 
that  the  agency  that  attempts  to  Impose  specific  practices  on  a  school 
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district  aasuntes  a  very  serious  responsibility-    It  is  not  clear  whether 
any  existing  practices  truly  warrant  a  major  diffusion  effort,  but  it  is 
completely  clear  that  the  selection  criteria  for  such  practices  would  have 
to  go  far  beyond  '^apparent  Itapact"  in  developer  sites. 
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13*2   Achievement-* Impact  Evaluation  as  a  Measure  of 


Plf fufllon^Svfltem  Ef fectlvenesfl 


the  achlevQoent-* Impact  evaluation  described  In  the  above  sections 
represents  only  one  limited  form  of  program  evaluation*    It  Is  a  very 
difficult  form  of  evaluation  and»  from  the  perspective  of  the  L£As»  It 
Is  not  necessarily  the  most  Important  form* 

Ultimately^  of  course*  achlev6ment**lmpact  evaluation  Is  the  only  way 
to  asaess  the  effectiveness  of  a  diffusion  system  thitt  Is  Intended  to 
Improve  student  achievement*    Unfortunately »  given  the  current  state*of-* 
the-*srt»  achlevement-^lmpact  evaluation  (for  bilingual  and  perhaps  most 
other  kinds  of  programs)  Is  Impossible  In  most  school  districts*    In  order 
to  produce  credible  achlevanent*lmpsct  evaluations^  a  school  district 
would  need  to  establish  and  maintain  a  data  base  that  Included  test  'scores 
and  biographical  data  for  all  students  In  all  subtest  areas  of  Interest* 
Given  such  a  data  bsse»  vhen  a  particular  group  of  students  waa  given  a 
new  special  treatment  It  should  be  possible  to  see  the  effects*  If  at^* 
on  program-student  test  scores  by  comparing  their  scores  before  And  after 
the  Introduction  of  the  new  program  to  the  background  made  up  of  the 
scores  from  all  non*program  students* 

Some  school  districts  are  attempting  to  develop  such  data  bases  and, 
In  the  futurf^,  achlevement*lmpact  evaluations  may  beccme  feasible  In  a 
much  wider  variety  of  districts*    In  the  meantime: 

•  Field  tests  of  diffusion  systems  ahould  employ  procesa  evalua- 
tions dealgned  to  determine  whether  or  not  the  Intended  practices 
are  Implemented  * 

•  The  asseasment  of  achievement  and  other  Impacts  should  be  deter- 
mined under  carefully  controlled  conditions  In  carefully  selected 
school  districts*    Before  undertaking  such  assessments^  imple- 
mentation of  the  practices  and  availability  of  appro;    ^ate  com* 
parlson  data  should  be  assured*    Due  conalderatlon  for  the  gen* 
erallzablllty  of  the  reaults  should  also  be  required* 
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13*3   Broader  Implications  for  Program-Evaluatlon 
Reguirementg  and  Guidelines 

The  frustration  on  the  parts  of  the  locr.l  evalustors  In  their  attempts 
tfo  develop  credible  Impact  evaluations  reflected  the  Impossibility  of 
meeting  many  of  the  Title  VII  requirements  In  any  meaningful  wsy  snd  the 
conviction  that  the  evaluation  reports  would  never  be  ueed  by  the  funding 
agency*    Ab  a  result,  BMC  recommends  that  evaluation  requirements  by  fed- 
eral agencies  (and  state  and  local  agencies,  as  well)  be  reconsidered  In 
terms  of  whether: 

•  The  requirements  can  be  met* 

•  The  results  will  be  used* 

Once  It  has  been  established  that  the  evaluations  are  needed  and  are 
possible, 

•  Adequate  guldel:l*^es  should  be  developed 

•  Adequate  funds  should  be  prm'lded 

•  Adherence  to  sound  procedures  should  be  required 

In  particular,  consideration  should  be  given  to~(a)  establishing 
long^tetm  data  collection  and  storage  procedures,  and  (b)  the  reporting 
of  longitudinal  data  on  a  less**than*annual  basis* 
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13*4    Subfltudv  II  Product!    A  Prellmlnary^Draf t  Evaluation  Manual 

The  major  product  of  the  impact  substudy  is  a  collection  of  guide- 
lines and  worksheets  developed  by  RMC  for  the  field^test  sites  during  the 
study*    These  materials  represented  an  attempt  to  solve  the  evaluation 
problems  in  the  various  problem  areas  discussed  above*    The  guidelines  and 
worksheets  were  subsequently  organized  into  a  prellminary^draf t  evaluation 
manual  dealing  with  performance- level  and  iiopact  issues  *    The  manual  does 
not  cover  process  evaluationf  monitoring  of  student  progress  and  other 
important  evaluation  topics* 

The  preliminary  draft  manual  emphasizec  realistic  solutions  (or  par- 
tial solutions)  rather  than  general  or  theoretical  principles*    It  is  In^ 
tended  as  a  starting  point  for  developing  a  set  of  highly  specific  and 
practical  guidelines  for  generating  useful,  local  evaluations  of  student 
achievement  in  bilingual  programs*    Such  a  manual  could  be  used  together 
with  a  process  evaluation  manual  to  develop  a  complete  blllngual^rogram 
evaluation*    The  draft  manual  is  Volume  III  of  this  report* 
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APPENDICES 


APPENDIX  A 
ADOPTER-SITE  RESULTS 


ADELANTE  -  SITE  A 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Secclna*    Sice  A  i&  a  large  di&cricc  in  a  cicy  of  158,000*    The  dis- 
trice  had  25  elementary  schools  and  a  complemenc  of  middle  and  high  achoola* 
Of  the  total  atudent  enrollment »  blacks  and  Hi&panics  comprised  50%  and  30% 
respectively*     Ten  of  the  districts'  elementary  schools  have  an  entirely 
non«vhite  student  enrollment*    The  city'a  Hiapanic  population  quintupled 
from  6»500  to  40,000  in  four  years  and  was  still  growing*    Hispanic  enroll* 
ment  incr^iased  by  Z5X  during  this  period,  to  an  estimated  5»000  students  of 
which  only  2»000  were  previously  receiving  bilingual**,  bicultural  instruct 
tion* 

Overview*    Site  A  decision  makers^  from  the  superintendent  on  down» 
were  supportive  of  bilingual  education*    The  second  year  the  district 
hired  a  new  superintendent  who  was  himself  bilingual*    The  district  had 
a  highly  regarded  Title  VII  program  for  a  full  funding  cycle*    In  addi* 
tion,  bilingual  services  were  available  in  the  diatrict  (IC^12}  and  were 
supported  by  district  funds*    Adoption  of  the  Adelante  project  was  an 
attetnpt  to  extend  bilingual  services  to  some  of  the  three  thousand  LKP 
students  identified  by  the  state  testing  program  and  not  receiving  special 
services* 

Project  start*up  was  delayed  for  several  months  into  the  school  year 
due  to  a  district*wlde  hiring  freeze*    The  project  was  Implemented  in 
oome  second  and  third  grade  classrooms,  in  addition  to  grades  K  and  1  ss 
proposed  for  Adelante  PIP  sites,  and  the  project  expanded  to  fourth  grade 
during  the  second  year* 

Decision  mskers*    Cne  of  the  decision  makers  (DMs)  is  district  direc** 
tor  of  bilingual  education  and  is  Puerto  Rican*    The  experience  of  the 
DHs  include  previous  Title  VII  program  administration,  atate  testing  of 
LES  children,  settling  a  suit  brought  by  the  community  and  complying  with 
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Office  of  Civil  Rights  (OCR)  guidelines »  and  a  district-supported  bilingual 
education  program*    The  school  board  also  had  minority  representation »  had 
created  the  position  of  bilingual  education  director^  and  had  pissed  a 
resolution  supporting  bilingual  education*    Because  of  this  previous  exper- 
ience tfith  bilingual  education^  DMs  had  little  trouble  understanding  and 
accepting  the  new  project  and  fitting  it  into  the  existing  organization* 
The  DHs  learned  of  the  bilingual  PIP  projecta  through  their  involvement  in 
Title  I  PIP  programs*    They  perceived  that  adoption  of  a  PIP  project  would 
enhance  their  opportunity  to  obtain  the  additional  funds  needed  to  expand 
their  bilingual  education  program*    They  were  able  to  see  the  ASK  and  a 
complete  Adelante  PXP  before  writing  their  proposal*    Adelar.te  was  regarded 
as  the  most  appropriate  PIP;  one  reason  was  because  the  Laidlaw  aeries 
recommended  in  Adelante  was  the  main  aeries  used  in  Puerto  Rico  and  a 
number  of  district  students  migrate  between  both  school  systems*    Also  the 
Adelante  curriculum  was  general  enough  for  the  project  to  be  easily  incor- 
porated in  the  district's  fairly  well  developed  bilingual  program*  How^ 
ever>  DMs  were  critical  of  certain  PlP^recommended  practices  and  adapted 
them  to  fit  local  needs*    Theae  adaptations  concerned  one  of  the  program 
goals  stated  in  the  PIP  and  the  number  of  aides  to  be  hired  for  the  proj- 
ect*   The  DMs  were  already  well  informed  and  it  was  relatively  easy  for 
the  project  director  (PD)  to  develop  good  communication*    The  project  ran 
smoothly  as  far  as  the  DHs'  policies  and  activities  were  concerned* 

Project  director*    The  PD  was  a  district  employee  who  was  well  ac-- 
quainted  with  district  personnel  and  practices »  and  with  the  existing 
bilingual  program*    She  was  bilingual  and  Hispanic »  had  course  work  in 
bilingual  education^  and  had  taught^  been  a  team  leader^  and  a  language 
specialist  in  the  district's  pr^^vious  Title  VZI  bilingual  program*  She 
had  minimal  administrative  experience^  was  hired  late»  and  was  not  ac- 
quainted Witt  the  proposal  or  the  PIP*    The  district  director  of  bilin-' 
gual  education  helped  to  orient  her »  and»  as  a  results  the  effect  of 
these  weaknesses  was  minimized*    The  PD's  oftice  was  located  at  the  dis** 
trict  office »  which  she  saw  as  important  in  establishing  her  administra- 
tive role*    However^  the  second  year  the  PD's  office  was  moved  to  another 
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district  building  because  of  overcrowding.    The  office  location  continued 
to  be  satisfactory.    She  was  not  allowed  to  hire  an  instructional  consul* 
tant  (IC)  directly  because  of  district  policy*  but  her  recommendation  was 
considered  in  the  selection  of  an  IC.    The  po  worked  effectively  at  all 
the  tasks  and  formed  a  good  decision^ntaking  team  with  both  the  district 
director  of  bilingual  education  and  the  project  IC.    Although  more  of  a 
team  approach  than  envisioned  by  the  PIP»  this  style  proved  effective  and 
appropriate  for  this  district.    Since  this  district  already  had  a  bilin* 
gual  education  program,  the  definition  of  roles  and  basic  components  of 
a  program  as  outlined  in  the  PIP  was  useful  mainly  as  a  checklist.  The 
Adelante  emphasis  on  grouping  and  the  use  of  learning  centers  was  adopted 
by  the  PD  and  implemented  in  the  classrooms. 

Project  support  staff.    The  IC  had  previous  experience  teaching  in  a 
bilingual  classroom,  and  was  well  inforjted  sbout  bilingual  and  elementary 
education.    She  was  able  to  develop  good  working  relations  with  the  Ts 
most  in  need  of  additional  assistance.    During  the  first  year,  the  IC  and 
evaluator  were  hired  late  since  the  whole  program  started  late.    For  the 
second  year,  a  community  consultant  position  was  added.    This  full-time 
position  was  a  modification  of  the  PlP'^specif ied  second  IC  in  that  the 
person  was  not  required  to  have  college  credentials;  however,  she  was  bi* 
lingual  and  Hispanic.    The  Adelante  support  staff  received  assistance  and 
consulting  fram  district^level  bilingual  and  evaluation  staff*    The  eval* 
uator  also  was  influenced  by  a  Ph.D.  program  in  which  he  was  enrolled. 

Project  instructional  staff.    During  start-up  no  new  teachers  (Ts) 
were  hired  for  the  project;  existing  Ts  were  bilingual  and  had  bilingual 
education  training  or  experience.    As  the  first  year  progressed,  severe 
overcrowding  in  one  classroom  made  an  additional  teacher  necessary.  Fi- 
nally one  Was  hired,  but  had  to  work  in  the  same  room  because  no  extra 
classroom  was  available.    During  the  second  year,  additonal  project  teach- 
ers were  hired  due  to  replacement  and  expansion  of  the  project.    With  one 
exception,  all  additional/new  project  Ts  were  bilingual;  the  monolingusl 
T  was  teamed  with  a  bilingusl  T. 
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During  the  firs*:  year*  three  of  Che  ceacher-aides  (TAs)  were  mono'^ 
lingual)  but  for  secorl  year  all  TAs  assigned  Co  project  cla&srooms  were 
bilingual.    During  the  first  year>  Ts  and  TAs  received  a  pre-servlce  work- 
shop modeled  on  Ade\ante  PIP  topics*  but  due  to  the  project's  late  start* 
It  was  compressed  into  six  days  instead  of  ten  as  recommended  by  the  PIP. 
Tlie  work£hop»  p^-epared  by  the  PD  and  IC»  used  district  and  TRC  bilingual 
expertise.    Ts  and  TAs  attended  in-service  on  a  voluntary  basis.  In- 
service  workshops  were  offered  by  Adelante  staff*  by  the  district  depart*** 
ment  of  bilingual  education*  and  by  the  SEA.    Ts  and  TAs  were  also  encour- 
aged to  enroll  in  college  or  adult  education  classes;  one  T  was  a  former 
TA  wlio  had  completed  college  with  district  encouragement.    Toward  the  end 
of  the  first  year*  they  were  able  to  suggest  topics »  however*  some  Ts  felt 
the  in-services  were  too  elementary  and  should  be  designed  to  meet  indi- 
vidual needs*    Prior  to  the  beginning  of  the  second  year»  all  Ts  and  TAs 
participated  in  a  two  week  pre-service  workshop  which  covered  general  orl-^ 
entation  topics  and  allowed  the  Ts  and  TAs  planning  and  working  time  in 
their  own  schools.    Second  year  in-service  was  conducted  by  the  PD  and 
support  staff.    It  included  a  session  in  which  Ts  and  TAs  planned  future 
staff  training  and  one  optional  reading  workshop*  as  well  as  several 
required  training  sessions. 

Other  personnel  (regular  staff*  community^  parents).    The  teachers' 
union  had  opposed  bilingual  education  several  years  previously*  but  was 
currently  officially  accepting  the  rationale  for  bilingual  education. 
Experienced  monolingual  Ts  were  being  dismissed  while  the  district  was 
recruiting  bilingual  staff;  one  teacher  had  brought  suit  against  the  dis- 
trict»  but  no  settlement  had  been  reached.    The  regular  teaching  staff 
had  not  been  formally  oriented  to  the  Adelante  project*  but  the  whole 
district  had  access  to  workshops  on  bilingual  education.    Project  school 
principals  were  given  the  choice  of  accepting  or  rejecting  the  project  at 
their  school*  however*  a  range  of  attitudes  towards  the  project  existed. 
One  principal  was  very  helpful*  yet  another  of  the  three  discouraged 
parents  from  coming  to  the  school.    The  principals  were  kept  informed 
about  the  project  by  frequent  visits  from  the  PD  and  the  10* 
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The  community  was  active  and  organized*    In  the  pas^.^  parents  had 
picketed  certain  schools  and  attended  key  school  board  meetings*    A  few 
years  ago  parents  and  ethnic  community  organizations  brought  a  class  ac- 
tion suit  against  the  di/?trict  and  OCR  also  brought  Guit*    The  parents' 
case  was  settled  by  a  consent  decree  that  alao  included  OCR  remedies*  A 
Puerto  Rican  had  been  serving  as  school  board  member  for  several  years* 
Some  schools  encouraged  parent  participation  to  the  extent  of  reserving 
lo'j^nges  exclusively  for  the  use  of  parents*    luring  the  first  year»  about 
20  percent  of  the  Adelante  project  parents  attended  school  or  project 
activities*  and  about  four  percent  helped  in  project  classrooms*  During 
the  second  year*  only  about  10  percent  of  the  parents  were  active  in 
daytime  school  events*    Parent  Advisory  Committees  (PACs)  met  monthly  at 
all  three  project  school/?*  and  parents  had  input  into  the  continuation 
propoaal*    English  classes  for  parents  were  attempted  and  dropped  but  the 
project  ataff  did  aerve  as  a  link  between  project  parents  and  community 
services  such  ^  adult  education* 

Other  resources  (materials/equipment,  facilities^  funds)*  Spanish- 
language  materials  were  already  available  in  the  district  due  to  other 
bilingual  projects*  but  more  were  needed  and  ordered*    Ts  were  not  required 
to  uae  PIP**recommended  materials  excluaively*  but  were  given  their  choice 
^possibly  due  to  the  district'a  experience  with  a  wide  range  of  materials* 
Some  of  these  materi;&ls  were  already  in  use  in  the  district*  However, 
each  school  limited  itself  to  one  English  basal*  and  the  choice  of  Spaniah 
readers  was  limited  to  two  or  three  aeries  district  wide*    The  district 
interpreted  federal  regulations  atrictly  and  would  not  buy  anything  in 
English  with  project  funds*    Overall*  the  PIP  had  a  minimal  impact  on  the 
selection  of  project  instructional  materials*    The  project  was  adequately 
funded*  but  the  district  itself  was  in  a  period  of  financial  difficulties* 
Therefore,  project  clasaes  were  abort  of  basic  supplies*    Some  project 
funds  were  spent  for  baaic  items*  and  some  Ts  also  used  their  personal 
funds  to  supply  their  classrooms*    A  diatrict  hiring  freeze  during  the 
first  year  also  caused  hiring  delays*  which  then  delayed  start-up  of  the 
whole  project*    Project  classrooms  were  not  adjacent  as  called  for  in  the 
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Adelante  PIP  because  whole  classrooms  already  in  session  had  been  assigned 
to  Che  project*    After  some  effort*  Ts  did  follow  PIP  suggestions  to  ar- 
range cheir  rooms  in  learning  centers  and  to  create  exhibits  in  both  lan* 
guages*    Towards  the  end  of  the  first  school  year»  one  classroom  became 
severely  overcrowded  and  the  addition  of  another  T  helped  the  instruc- 
tional»  but  not  the  space  problem*    During  the  second  year  adequate  class- 
room space  existed*    During  both  years  the  PD  and  IC  had  adequate  office 
space* 

Plans  and  constraints*    DHs  saw  both  the  ASEC  and  the  Adelante  PIP 
prior  to  writing  the  proposal*    They  liked  the  vagueness  of  the  PIP  as 
it  related  to  instruction  because  this  enabled  them  to  use  their  own 
curriculum  and  to  incorporate  the  district  objectives  into  the  Adelante 
project*    The  ?D  and  the  IC  used  the  PIP  extensively  during  start-up* 
Pre-service  instruction*  for  example*  was  modeled  upon  jflP  suggestions* 
Ts  did  not  use  the  PXP»  although  it  was  distributed  to  them*    As  time  went 
on»  the       and  the  IC  referred  to  it  less*    The  district  was  subject  to 
many  regulations  that  were  not  always  consistent  although  they  affected 
the  same  students;  the  district  responded  by  following  the  m,)st  stringent 
regulations*    During  the  first  year»  the  state  was  testing  all  LES  children 
and  a  Title  1  £SL  program  also  required  language  testing*  so  the  Title  Vll 
project  made  use  of  the  same  test  in  order  to  avoid  overtesting  the  chil- 
dren*   The  district  was  legally  required  to  work  toward  OCR  compliance  and 
had  to  report  quarterly*    Some  Office  of  Bilingual  Education  regulations 
such  as  organizing  a  E^arent  Advisory  Committee*  or  using  15  percent  of 
the  funds  for  staff  training,  were  easy  to  follow*    However,  the  require- 
ment not  to  segregate  was  difficult  in  a  district  that  was  already  having 
problems  in  this  area*    All  the  various  testing  plans  affected  the  Title 
Vll  project's  choice  of  tests,  and  it  was  virtually  impossible  to  estab" 
lish  a  no-treatment  expectation  as  required  by  the  regulations* 

Students*^   Hispanic  and  Black  students  made  up  the  majority  of  the 
school  population*    Virtually  all  students  in  project  classrooms  were 
LES  and  of  Puerto  Rican  origin*    There  was  a  high  degree  of  mobility  and 
new  students  enrolled  throughout  the  year,  some  of  them  coming  directly 


272 

2U 


ADEL-A***7 


from  Puerto  Rico*    Project  claaflrooms  were  selected  from  schools  that  had 
a  high  proportion  of  LBS  students  and  limited  bilingual  services*  though 
all  first  and  second  grade  project  classrooms  participated  in  a  Title  X 
ESL  pull-out  project*    There  were  more  eligible  students  than  the  project 
was  able  to  serve*    As  a  result  of  the  project*  the  Ts  had  more  training 
and  greater  access  to  an  instructional  consultant*    They  also  had  extra 
money  for  materials  and  supplies*    The  Adelante  PIP  did  not  influence 
classroom  staffing  patterns  since  full*time  £ides  already  existed  in 
all  early  elementary  grades* 

Instructional  treatment*    District  policy  required  a  full-time  aide 
in  all  kindergarten*  first,  and  second  grade  classrooms*  while  the  PIP 
only  called  for  a  part-time  aide  beyond  kindergarten*    The  aides  were 
assigned  an  instructional  role  in  the  classroom,  but  because  of  large 
classes  and  scarcity  of  materials  in  some  areas,  a  completely  individual- 
ized system  of  Instruction  was  rarely  possible*    Grouping  occurred  in 
some  but  not  all  classes*    The  main  effect  of  the  project  on  the  students 
was  to  provide  instruction  in  Spanish  and  to  organize  learning  centers  in 
classrooms*    All  kindergarten  instruction  was  in  Spanish*    First  and  sec- 
ond grade  students  received  increasing  amounts  of  ESL  instruction,  but 
English  reading  was  not  commonly  begun  until  third  grade*    About  half  the 
students  were  pulled  out  for  a  thirty^minute  Title  I  ESL  lesson*  Teachers 
used  a  variety  of  Spanish  and  English  materials*    A  Spanish  color-coded 
reading  syst^  (LeoColor)  was  widely  in  use*    The  first  year  there  were 
six  classrooms  with  kindergarten  and  first  grade  project  students  located 
in  three  different  schools*    During  the  second  year  there  were  three  kin- 
dergarten, five  first  grades,  and  three  second  grade  classrooms*  Addi- 
tional first  grade  classes  were  added  because  student  enrollment  increased 
at  this  level* 

First  grade  students  received  eighty  to  one  hundred  minutes  of  Span- 
ish reading  and  language  activities  daily  or  which  forty  to  fifty  minutes 
formed  the  core  reading  program.    They  had  twenty  to  forty  minutes  of  math 
and  twenty  to  forty  minutes  of  ESL*    Second  grade  students  received  sixty 
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to  ninety  minutes  of  Spanish  reading  and  language »  of  which  about  forty 
minutes  formed  the  core  reading  program*    They  had  thirty  to  sixty  minutes 
of  math,  thirty  to  fifty  minutes  of  ESL,  and  thirty  to  forty-five  minutes 
of  science  or  social  studies*    The  sy^hedules  of  students  who  were  pulled 
out  for  ESL  varied  slightly* 
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ADELANTE  -  SITE  B 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Secclnfi*    Sice  B  is  a  consorcium  of  five  small  LEAs  surrounding  a 
major  metropolitan  area*    The  LEAs  vary  in  size  from  30  to  250  square 
mileSi  and  in  enrollment  from  461  to  949  students*    Three  of  the  LEab  had 
only  one  elementary  school  while  the  remaining  two  LEAs  each  had  two  ele-> 
mentary  schools*    The  Spanish  surname  enrollment  at  these  schools  ranged 
from  10  to  2UX  of  the  total  enrollment* 

Overview*    This  proJect^*a  consortium  of  five  school  districts^^as 
managed  by  a  State  Education  Agency  (SEA)  service  center*    The  consortium 
structure  greatly  complicated  administration  of  the  project*    Each  LEA 
had  different  policies^  procedures  and  calendars  as  well  as  slightly  dif-> 
ferent  student  populations  and  needs*    The  distances  between  districts 
were  great  and  travel  consumed  a  great  deal  of  some  of  the  project  staff's 
time* 

Decision  makers*    There  were  two  layers  of  decision  makers  (DMs)  in 
the  consortium:    the  SEA  service  center  DMs  and  the  DMs  at  each  of  the 
five  participating  LEAs*    One  of  the  goals  of  the  SEA  service  center 
was  to  increase  service  to  LEAs  needing  help  with  bilingual  education 
and  the  Adelante  PIP  provided  a  way  of  doing  this*    The  service  center 
CUs  were  not  bilingual/bicultural  and  assigned  their  in^house  bilingual 
consultant  to  write  the  proposal*    This  consultant  attended  a  Title  VXI 
proposal-writing  workshop  Jointly  sponsored  by  the  SEA  and  the  regional 
training  resource  center^  (TRC)  designed  to  assist  LEAs  in  applying  for 
Title  VII  funds  and  to  introduce  the  PiP  materiala*    The  ASK  and  the 
Adelante  PIP  were  available  to  the  proposal  writer*    The  proposal  writer 
subsequently  became  the  project  director  (PD)  and  kept  the  DMs  informed 
throughout  the  project*    The  SEA  service  center  staff  was  well  organized 
and  the  project  started  on  time* 
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One  of  the  four  initial  LEAb  withdrew  from  the  consortium  before 
start-up  because  it  was  unwillingness  to  make  the  required  changes.  How** 
ever,  the  PD  was  able  to  add  two  additional  LEAs,  for  a  total  of  five  LEAs. 
The  LEA  DMs  were  not  bilingual/bicultural  and»  although  they  all  had  been 
required  to  comply  with  state  bilingual  education  regulations  and  were 
receiving  state  money*  four  of  the  five  diatricts  had  almost  no  knowledge 
or  resources  in  this  area.    The  project  provided  the  DMs  with  a  convenient 
method  of  complying  with  existing  state  regulations*  so  most  of  them  had 
positive  attitudes.    The  LEA  DMs  were  kept  informed  through  bimonthly 
meetings  with  the  PD  and  support  staff. 

Project  director.    The  PD  was  bilingual  and  Chicana;  she  had  been 
the  bilingual  consultant  at  the  SEA  service  center  that  subsequently 
administered  this  project.    She  was  well  acquainted  with  bilingual  pt^c^ 
tices»  the  LEAb'  needs*  and  the  service  center  organization.    Ab  the 
author  of  the  proposal,  she  was  thoroughly  knowledgeable  about  the  PIP 
and  the  project  at  the  time  of  start-up.    She  had  no  previous  management 
training  yet  functioned  effectively  in  her  new  role.    A  lot  of  management 
skills  acquired  in  her  consultant:  job  were  transferrable  to  the  PD  job. 
She  hired  support  staff*  clarified  roles  and  responsibilities  and  engaged 
the  staff  in  joint  planning*    yet  she  had  some  trouble  working  with  the 
project  evaluator.    She  liked  the  management  aspect  of  the  PtP  projects 
and  felt  the  staff  development  component  was  attractive  to  LEAs.  tt 
appears  that  the  PtP  project  was  also  seen  as  a  means  of  getting  funding. 
Although  the  PD  read  and  consulted  the  PIP>  much  of  the  PtP  management 
plan  was  not  applicable  to  the  consortium  structure  of  this  project. 

Project  support  staff.    The  PD  hired  support  staff  in  time  for 
start-up  and  clarified  job  assignments.    Two  full-time  ICs  were  hired 
for  the  first  year  due  to  the  extra  driving  time  and  coordinating  diffi- 
culties inherent  in  a  project  with  five  LEAb.    Both  ICs  were  bilingual; 
one  IC  was  Anglo*  the  other  was  Cuban.    Both  ICs  had  previous  experience, 
and  appropriate  training  in  bilingual  education.    The  work  of  the  ICs  was 
well  coordinated  to  take  advantage  of  the  time  and  special  skills  of  each 
person.    Though  they  used  the  PIP  as  a  checklist  and  as  a  source  for  ideas* 


chey  found  that  Issues  such  as  selecting  materials  wlch  limited  funds  or 
working  with  monolingual  project  Is  were  not  clearly  discussed*    The  proj- 
ect evaluator  was  bilingual*  Chicano  and  experienced  in  bilingual  educa** 
tion  evaluation* 

Project  instructional  staff*    During  the  first  yaar^  eight  of  the 
ten  project  teachers  (is)  had  state  bilingual  certification;  the  remain- 
ing two  Is  were  not  bilingual*    All  the  teacher-aides  (TAs)  spoke  Spanish^ 
but  onii  TA  was  not  a  native  speaker  and  was  not  very  fluent*    During  tho 
second  year»  16  of  the  20  project  Is  were  considered  sufficiently  bilin-* 
gual  by  the  FD  and  ICs*    Is  were  selected  for  the  program  by  their  prin- 
cipsls  and  districts*    During  the  first  year»  one  more  T  was  needed  at  one 
school  and»  though  the  position  had  been  sdvertised»  no  bilingual  Is  could 
be  found*    This  situation  wat^  corrected  the  following  year*    When  an  over~ 
crowding  occurred  in  another  LEA»  a  second  T  plsced  in  one  clsssroom  for 
the  latter  part  of  the  school  yeai*    This  resulted  in  over-crowding  of 
the  classroom»  making  group  work  difficult  and  individual  attention  almost 
non-existent*    Some  of  the  Ts  were  hired  especially  for  the  project*  The 
first  year  onu.  district  hired  project  TAs  late»  how:^ver  student  Ts  In 
project  classrooms  were  performing  TA  functions  at  no  cost  to  the  district* 
During  the  second  year»  one  class  had  no  TA  for  part  of  the  year*    In  one 
LSA  during  the. first  year»  the  bilingual  Ts  acted  as  resource  ts  and  moved 
between  kindergarten  and  first  grade^  creating  in  effect  a  part-time  bi*" 
lingual  program*    During  the  second  yesr»  Ts  had  responsibility  for  com- 
biniation  classrooms  encompassing  two  grade  levels*    In  another  LEA»  Ts 
were  organized  into  teams  consisting  of  a  bilingual  T  and  monolingual 
English  T*    Students  were  exchanged  between  these  classes*    During  the 
first  year,  Ts  and  TAs  from  three  of  the  LEAs  received  a  two-week  preser- 
vice  workshop;  the  two  other  LEAs  had  not  yet  joined  the  consortium*  All 
the  project  Ts  and  TAs  received  in-service  trsining  conducted  by  project 
staff  and  consultants  once  a  month  the  first  year  and  bimonthly  the  second 
year*    All  the  teachers  received  orientation  on  the  pip  manuals,  but  not 
all  read  it*    Mbst  liked  the  PIp-recommended  materials,  classroom  visits 
by  the  instructional  coordinstor  (IC)  and  the  workshops,  but  some  Ts  pre- 
ferred to  use  their  own  texts  and  methods*    Some  project  features  were 
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less  relevant  to  the  two  Is  who  were  extremely  limited  in  Spanish.  Al- 
thought  some  Is  visited  each  other's  classrcoiDs»  the  geographic  distance 
between  participating  LKAs  made  close  teamwork  difficult. 

Other  personnel  (regular  staff,  community.  Parents)*    There  was  no 
orientation  by  the  project  staff  for  the  regular  school  staffs,  and  the 
attitudes  varied  across  LEAs.    One  district  had  a  principal  who  volun- 
teered for  the  program*  took  Spanish  lessons,  addressed  a  PAC  meeting  in 
Spanish,  and  developed  staff  enthusiasm  for  the  project.    The  second  year, 
this  principal's  enthusiasm  waned  somewhat  and  there  was  little  support 
for  the  use  of  Spanish  in  second  grade.    Another  principal  who  had  mono- 
lingual Ts  in  project  classrooms  was  not  enthusiastic  about  following 
project  guidelines.    A  third  principal  did  not  follow  state  regulations 
for  bilingual  education.    Principals  participated  in  the  bimonthly  meet- 
ings with  the  PD  and  ICs.    Several  LEAs  had  bilingual  Ts  who  shared  stu- 
dents with  regular  Ts,  and  engaged  in  joint  planning.    However*  a  project 
T  and  a  regular  T  who  shared  a  classroom  communicated  very  little  despite 
an  absence  of  physical  bnrriers.    Bach  taught  their  own  students  exclu- 
sively . 

Before  the  project  was  installed,  there  had  been  little  involvement 
of  parents  or  community  in  school  affairs.    For  the  first  year,  two  LEAs 
had  good  attendance  at  their  school  project  functions,  and  had  some  parents 
assist  in  uhe  classroom.    The  other  three  LEAs  had  less  success,  partly 
because  of  distance  problems  for  the  parents.  The  large  distance  between 
the  consortium  LEAs  also  made  it  difficult  for  project  staff  to  establish 
community  ties.    Parent  participation  greatly  improved  by  the  second  year, 
partly  because  one  IC  was  assigned  to  work  exclusively  with  parents.  Sev- 
eral parents  from  each  school  were  elected  and  a  consortium-level  PAC  meet- 
ing was  held,  but  this  was  not  practical  due  to  the  distance  separating 
the  LEAs.    There  were  no  negative  responses  to  the  program. 

Other  resources  (materials/et^uipment,  facilities*  funds)*  The  PD 
and  ICs  ordered  materials  suggested  in  the  PiP  and  distributed  them  to 
tba  classrooms.    During  the  first  year,  their  inexperience  resulted  in 
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too  much  money  being  spent  tn  soe^^  areas  so  that  no  funds  were  left  £or 
others.    The  first  year^  ICs  encouraged  all  project  Ts  to  use  the  same 
core  texts,  but  because  materials  arrived  late,  it  was  difficult  to  get 
some  Ts  to  change  in  mid-program.    The  second  year,  the  project  staff 
emphasized  standardizing  objectives  rather  than  standardizing  texts.  Only 
about  one**third  of  the  texts  iised  were  PlP^recomntended,  yet  all  five  LEAs 
used  the  same  PIP*recommended  Spanish  reading  basal.    Some  materials  were 
developed  by  Ts  during  in-service.    Facilities  varied  enormously  across 
L£Aa**^some  v/ere  very  modern  and  well  equipped  and  one  was  quite  old  and 
lacked  air  conditioning^  which  was  a  handicap  in  this  climate.    The  amount 
of  funds  varied  across  districts,  so  some  Ts  were  better  equipped  than 
others.    Project  funds  were  adequate  the  flvz'c  year,  but  were  not  in- 
creased the  second  year  in  spite  of  vertical  expansion  to  another  grade. 

Plans  and  constraints.    The  Adelante  PIP  was  not  very  appropriate 
for  a  consortium  project,  however  project  staff  made  a  reasonable  effort 
to  follow  it.    State  law  required  bilingual  education  in  grades  K-3  if 
certain  conditions  existed,  yet  it  provided  little  money  and  inadequate 
consulting  services  to  put  this  in  operation.    The  state  also  had  exit 
criteria  but  students  were  exited  earlier  in  some  schools.    The  project 
was  seen  by  DMs  as  a  way  of  complying  with  state  regulations.    As  part 
o£  the  project  plans,  the  ICs  engaged  in  detailed  planning  of  bilingual 
curriculum  and  the  writing  of  instructional  objectives,  although  this 
was  not  specified  by  the  PIP.    One  of  the  LEAs  had  a  busing  schedule  dur- 
ing both  years  that  greatly  limited  the  classroom  time  of  some  students. 

Students .    Mbst  students  in  project  clessroom^  were  LBS,  and  the  stu-* 
dent  population  was  relatively  sta  le.    In  some  districts,  students  who 
qualified  £or  the  program  were  bused  to  one  school  to  comprise  a  class. 
In  these  schools t  there  were  few  Chicano  children  outside  the  project 
classes.    Project  classes  in  one  LEA  were  ethnically  mixed.    In  another 
LEA  the  bilingual  teacher  functioned  as  a  resource  teacher  for  about  half 
o£  the  instructional  day;  in  the  absence  of  the  resource  teacher,  classes 
were  mixed.    In  the  other  three  LEAs*  project  students  Joined  other  stu- 
dents only  £or  art,  music  and  physical  education. 
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In  three  L£As»  instruction  in  Spanish  and  Spanish  materials  were 
available  to  LES  students  for  the  first  time  through  the  Adelante  project* 
In  one  LEA  even  with  the  project:,  little  Spanish  instruction  occurred* 
Another  LEA  already  had  Spanish  Instruction  and  materials  so  the  role  of 
the  project  was  supplementary*    This  particular  LEA  alao  had  TAs  in  the 
past»  but  for  the  other  four  LEAa»  the  addition  of  xAs  to  the  classroom 
was  a  laajor  change  made  by  the  project*    The  involvement  of  the  parents, 
the  visits  of  the  IGs,  and  the  extra  training  received  by  Ts  may  have 
affected  classroom  practices  also*    Students  placed  in  the  project  were 
those  qualifying  fo^^  the  state  bilingual  education  program;  the  LEAs 
were  choses^  because  they  qualified  for  state  programs  but  lacked  ejcperi* 
ence  and  resources  needed  for  implementation* 

Instructional  treatments    Site  B  is  a  consortium  of  five  districts 
with  enough  differences  in  instructional  treatment  to  warrant  individual 
discussion*    The  project  staff  developed  objectives,  which  were  available 
to  teachers  in  all  five  districts*    All  teachers  participated  in  the  same 
in-service  training*    During  the  first  year  the  project  consisted  of  six 
kindergarten  and  six  first  grade  classes*  The  second  year  there  were  six 
kindergartens,  seven  first  gracies,  and  eight  second  grades;  the  uneven 
numbers  were  due  to  team  teaching  and  mixed  grade  clasaes* 

District  A 

The  first  year  district  A  had  two  kindergarten  and  first  grade 
classes  at  two  schools;  the  second  year  each  school  added  a  second  grade* 
Because  there  were  only  two  project  teachers  per  school,  the  kindergarten 
and  first  grade  students  were  combined,  and  sometimes  the  kindergarten  and 
second  graders  wtsra  also  in  the  same  room*    There  were  between  ten  and 
twelve  students  in  each  grade*    Both  second  grade  teachers  were  replace* 
ments  for  the  original  teachers  who  left  a  few  months  before  the  end  of 
the  1978-79  school  year*    The  aide  in  the  second  grade  class  was  only 
present  part  of  the  year*    All  the  teachers  and  aides  were  bilingual  and 
Chicana,  except  for  one  of  the  second  grade  replacements*    The  aides 
participated  in  the  students'  instruction* 
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Reading  was  grouped  and  math  was  individuslized *    By  the  end  of  the 
school  year»  almost  all  instruction  at  the  second  grade  was  in  English* 
The  classrooms  had  li&tsning  and  activity  centers*    Some  oral  English 
development  was  done  by  non-project  teachers* 

First  grade  students  received  between  ninety  and  one  hundred  and  ten 
minutes  of  Spanish  reading*    Host  also  received  thirty  minutes  of  English 
reading  although  a  few  were  in  oral  English  only*    All  first  grade  stu^ 
dents  received  forty  minutes  of  oral  English*    Math»  which  was  taught 
increasingly  in  English,  vsried  between  the  two  first  grades  from  forty- 
five  to  sixty  minutes*    The  second  grade  students  were  not  receiving  any 
Spanish  reading  instruction  by  the  end  of  the  year*    English  reading  and 
oral  language  development  was  about  seventy  minutes,  with  forty  minutes 
of  that  time  devoted  to  the  basal  series*    Math  varied  between  the  two 
classes  from  forty-^five  to  eighty  minutes  a  day* 

District  B 

The  first  yesr  district  B  had  one  kindergarten  and  one  first  grade* 
The  second  year  a  second  grade  class  was  added,  and  because  of  the  size 
of  the  first  grade  clsss,  an  additional  teacher  was  hired  for  the  isst 
half  of  the  year*    All  teachers  and  aides  were  bilingual  and  all  except 
one  were  Chicano*    The  aides  were  part  of  the  instructional  team*  Stu- 
dents were  grouped  for  each  academic  subject* 

The  first  grade  made  daily  use  of  an  oral  language  development  pro-^ 
gram  in  both  Spanish  and  English  (Let^s  Learn  Language)*    At  the  second 
grade,  most  instruction  was  in  English* 

The  first  grade  spent  seventy  minutes  ^  day  on  Spanish  reading  and 
ten  students  spent  one  hour  daily  in  English  reading*  First  grade  stu- 
dents also  received  math  instruction  in  Spanish  for  one  hour  daily*  The 
second  graders  received  Spanish  reading  instruction  for  the  first  three 
months*  All  second  grade  students  had  forty  minutes  of  English  reading 
and  additional  English  oral  language  development*  They  received  one  hour 
of  math  in  Spanish* 


281 


ADEL-B**-8 


District  C 

The  first  yesr  district  C  had  one  kindergarten  and  one  first  grade 
class*    The  second  year  the  first  grade  became  a  combination  first  and 
second*    Second  grade  students  participated  In  the  bilingual  program  only 
In  the  morning  and  went  to  various  homerooms  In  the  afteraoon;  first  grade 
students  were  In  the  pro^^ram  all  day*    The  first  year  teacher  aides  were 
hired  iste  because  of  the  presence  of  student  teachers*    All  teachers  snd 
aides  were  bilingual*    During  the  first  year  neither  teacher  was  Chlcano 
but  the  second  year  there  wss  a  Chlcana  teacher*    Students  were  grouped 
for  reading  but  not  for  math* 

Some  students  were  pulled  out  for  the  state  compensatory  education 
program  and  for  Title  I  reading  lab*    Oral  language  development  and 
£SL  were  part  of  the  curriculum*    All  first  grad^  students  began  English 
reading  at  mld-yesr*    There  was  very  little  Spanish  reading  at  the  second 
grade  level* 

First  grade  students  received  fifteen  to  thirty  minutes  of  Spanish 
reading  depending  on  their  grouping »  snd  forty-^flve  minutes  of  English 
resdlng  for  the  last  half  of  the  year*    They  also  had  forty-five  minutes 
of  £SL  and  forty^flve  minutes  of  math*    Second  grade  students  received 
sixty  to  ninety  minutes  of  English  reading  and  twenty  to  thirty  minutes 
of  oral  English*    They  had  thirty  to  forty  minutes  of  math  and  no  sched* 
uled  time  for  Spanish  reading* 

District  D 

The  first  year  the  bilingual  project  at  District  D  consisted  of  one 
kindergarten*  and  two  first  grade  classes;  two  second  grades  were  added 
the  second  year*    Because  of  a  stable  population  almost  all  first  and 
second  grade  project  students  hsd  also  been  In  the  project  the  previous 
year*    Seventy^flve  percent  of  project  students  were  bussed  during  school 
tlme»  at  a  loss  of  seventy  minutes  of  Instructional  time*    The  project 


282 


ADEL-B*  **9 


classes  integrated  with  other  classes  for  music*  art»  and  physical  educa- 
tion* 

The  language  of  instruction  was  English  on  Monday*  Wednesday*  and 
Friday*  and  Spanish  on  Tuesday  and  Thursday*    The  previous  year,  three 
days  a  week  had  been  devoted  to  Spanish*  but  district  administration 
was  placing  increasing  emphasis  on  English* 

First  grade  students  had  fifty  minutes  of  Spanish  reading  of  which 
fifteen  were  devoted  to  the  basal  reader*  seventy  minutes  of  English  read** 
ing  of  which  twenty  were  devoted  to  the  basal  reader^  and  thirty-five 
minutes  of  math*    First  grade  students  began  English  reading  sfter  some 
time  in  oral  English  and  continued  to  receive  ESL  instruction*  Second 
grade  students  received  fifty  minutes  of  Spanish  reading,  seventy  minutes 
of  English  reading,  and  seventy-^f  ive  minutes  of  math*    All  second  grade 
students  began  English  reading  at  the  mid**year  point* 

District  E 

The  bilingual  project  at  District  E  consisted  of  one  self-contained 
kindergarten  class,  and  two  first  and  second  grades  using  a  team  teaching 
model*    Aides  were  assigned  a  clerical  and  support  role  in  some  of  the 
classrooms*    In  most  classes  students  were  grouped  by  ability*  Students 
were  exchanged  between  teachers  for  team  teaching  purposes  and  also  for 
integration*    Although  some  teachers  knew  sl  little  Spanish,  including  one 
teacher  in  each  team,  the  project  director  and  staff  did  not  consider  any 
of  these  teachers  truly  bilingual*    None  of  the  teachers  were  Hispanic, 
half  of  the  teachers  were  black  and  hslf  were  white*    The  aides  also  were 
not  bilingual,  although  during  the  first  year  the  aide  spoke  a  little 
Spanish* 

Spanish  reading  was  taught  with  a  basal  series  in  first  grade  and 
with  programmed  materials  in  second  grade*    Math  was  taught  primarily 
in  English*    Many  readiness  skills  commonly  taught  in  kindergarten  were 
taught  at  the  first  grade*    Most  second  gracJe  students  were  pulled  out 
for  an  additional  Title  I  reading  lab* 
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First  grade  students  received,  thirty  to  forty  minutes  of  Spanish 
reading  and  forty-five  minutes  of  math*    Only  a  very  few  students  were 
reading  in  £nglish»  but  the  rest  had  one  hundred  and  fifteen  minutes 
of  ESL  and  oral  Engli&ti  language  development*    Second  grade  students 
had  sixty  minutes  of  Spanish  reading,  sixty  minutes  of  English  reading 
and  an  additional  thirty  minutes  of  oral  English  language  development, 
and  forty-five  minutes  of  math*    Second  grade  students  began  English 
reading  three  months  into  the  school  year*    Criteria  for  beginning 
English  reading  was  a  1*2  level  of  Spanish  reading  and  oral  comprehen- 
sion of  basal  vocabulary* 
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ADEUHTE  -  SITE  C 

PROJECT  SUHHARY 
1977-1978  and  1978-1979 

Setting*    Site  C  is  s  large  district  locstcd  in  s  medium-sized  city 
with  LES  students  msking  up  s  sniall  percent  sge  of  the  tot  si  populstion. 

Overview.    The  Adelsnte  project  st  this  site  was  plsgued  by  admlnis* 
trative  and  organizational  problems  that  adversely  affected  the  project. 
The  Adelante  Title  VII  project  was  designed  to  take  over  the  state  program 
one  year  at  a  time  and  required  close  coordination  between  the  two  proj^ 
ects.    During  the  first  year»  the  directors  of  both  projects*  their  dmme* 
diate  supervisors*  and  the  principal  of  the  project  school  seemed  incap* 
able  of  working  together.    The  chain  of  command  was  unclear*  and  decisions 
wure  frequently  inconsistent.    Decisions  about  the  project  were  frequently 
made  by  the  principal  or  another  administrator.    As  a  result*  it  was  al* 
most  impossible  for  the  Adelante  project  director  (PD)  to  manage  the  proj* 
ect  effectively*    During  the  second  year*  the  Adelante  PD  and  the  director 
of  the  state  program  were  both  new  and  worked  cooperatively.  However* 
problems  with  the  principal  and  the  chain  of  command  continued*    As  a  re* 
suit*  the  state  program  director*  who  was  in  charge  of  the  entire  districts' 
bilingual  program*  including  the  Adelante  project*  resigned  at  the  end  of 
the  second  year* 

This  site  had  a  half*day  program  at  the  first  and  second  grade  level* 
Students  were  in  project  classrooms  in  the  morning  and  then  separatied  into 
different  non-project  classrooms  in  the  afternoon*    The  PIP  did  not  lead  to 
the  development  of  detailed  curriculum;  this  was  mainly  because  of  the  many 
other  problems  encountered  by  the  project. 

Decision  makers.    None  of  the  district  decision  makers  (DMs)  were  bi* 
lingual/  bicultural.    They  mre  fairly  well  informed  about  funding  sources. 
The  director  of  specially  funded  programs  (DSFP)  wrote  the  proposal  and 
contacted  PIP  diff users*  although  her  initial  information  about  bilingual 
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PIPb  came  from  a  State  Facilitator  vith  the  National  Diffusion  Network* 
Although  a  state  bilingual  project  had  existed  in  the  district  for  five 
years,  DMs  wanted  to  use  federal  money  and  the  PIP  to  improve  a  project 
that  was  not  considered  successful  or  popular  with  parents*    DMs  planned 
to  have  the  Adelante  project  supplant  the  state  project  a  year  at  a  time, 
but  the  organizational  consequences,  especially  for  the  respective  project 
directors  (PDs),  remained  unclear*    Because  only  the  ASK  and  not  the  ac-* 
tual  Adelante  PIP  was  available  to  them  st  the  time  of  proposal  writing, 
the  local  DMs  did  not  know  the  details  of  the  project  they  were  agreeing 
to  adopt*    In  addition,  implementing  the  project  in  detail  was  not  the  msin 
concern  of  local  decision  makers*    They  saw  the  PIP  as  a  means  of  getting 
funds  and  as  a  means  of  improving  the  existing  program* 

During  the  first  year  the  state  and  federal  programs  reported  to  dif- 
ferent supervisors,  making  program  cooperation  difficult*    An  attempt  to 
have  one  director  for  both  bilingual  programs  was  abandoned  because  OBE 
required  Adelante  to  have    its  own  PD*    During  the  second  year  an  attempt 
was  made  to  have  both  programs  follow  the  same  chain  of  command  but  confu** 
sion  of  functions  persisted*    The  DMs  did  not  select  a  PD  either  year  who 
was  knowledgeable  or  experienced  bilingual  education  at  the  elementary 
level*    During  project  start*up,  the  district  was  under  a  state  mandate 
to  desegregate  and  the  DMs  decided  to  move  both  bilingual  projects  to  a 
previously  all-white  school  in  order  to  improve  the  ethnic  balsnce  of  the 
student  population*    As  a  result,  the  Adelante  project  did  not  get  off  to 
a  strong  start*    Some  old  project  staff  resented  the  new  project*  The 
move  to  a  new  school  isolated  the  project  from  its  target  community,  and 
because  the  DMs  perceived  the  project  in  terms  of  a  qoota  of  minority  stu** 
dents,  the  principal  was  reluctant  to  accept  more  LES  pupils  than  necessary 
into  his  school*    As  required  by  federal  regulstions,  DMs  invited  a  non- 
public school  to  participate  in  the  project  and  the  offer  was  accepted, 
though  the  non**public  school  had  fewer  LES  chidren  than  anticipated* 
Project  staff  from  both  school  systems  worked  well  together  to  jointly 
implement  the  project* 
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Project  director*    With  Input  from  Spanish-speaking  community  groups » 
the  DMs  selected  the  first  year  PD*    Already  a  district  employee,  she  was 
blllngual/blcultural  but  not  from  the  same  group  as  the  majority  of  the 
students*    As  a  former  counselor,  she  had  a  lot  of  community  contacts  but 
lacked  experience  and  training  In  bilingual  education  and  was  reluctant 
to  accept  the  job*    This  site's  PD  role  was  different  from  that  described 
In  the  PIP*    The  PD  and  the  Instructional  coordinator  (IC)  positions  were 
combined,  and  the  person  was  housed  at  the  school  to  function  as  a  school- 
level  coordinator  rather  than  as  a  dlstrlct^level  administrator*    Aa  a 
result,  many  of  the  functions  assigned  the  PD  In  the  PIP  were  performed 
by  the  district  DSFP*    This  person  assumed  the  title  of  director  and  took 
care  of  grant  writing,  budget  administration,  and  district-level  public 
relations,  while  the  school*level  director  (called  coordinator  by  the 
district)  was  responsible  for  program  decisions,  planning  of  Inservlce, 
parent  Involvement,  and  writing  of  the  final  report*    The  PD  was  officially 
hired  In  mld*^August,  which  delayed  some  start^^up  tasks,  such  as  ordering 
materials,  and  caused  others,  like  pre-servlce  training,  to  be  abandoned 
completely*  In  addition,  the  PD  had  to  coordinate  with  the  state  program 
despite  the  uncertain  relation  of  the  two  programs  and  poor  working  rela- 
tions between  the  two  directors*    She  also  had  to  work  with  a  principal 
that  was  more  concerned  with  maintaining  racial  quotas  than  with  serving 
LES  children*    She  chose  not  to  continue  for  the  second  year* 

The  second  year  PD  was  selected  by  district  administrators  after  ad^ 
vertlslng  widely  for  the  position;  however,  she  did  not  have  more  elemen- 
tary bilingual  education  experience  than  her  predecessor*    She  was  origi- 
nally hired  to  be  the  project  evaluator  and  became  the  PD  after  some 
project  reorganization  by  the  DHs*    The  role  and  limitations  of  the  PD 
position  remained  unchanged  the  second  year,  and  the  second  year  PD  also 
resigned* 

Project  support  staff*    There  was  a  lot  of  staff  turnover  during  the 
two  years  of  the  project*    During  the  first  year,  the  IC  role  was  filled 
by  the  PD*    This  was  an  adequate  level  of  commitment  considering  the  small 
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number  of  project  students.    She  related  well  with  students*  but  lacked 
experience  and  training  in  bilingual  methodology  and  in  elementary  educa* 
tion.    As  a  result,  the  PD/IC  lacked  credibility  and  the  instructional 
program  lacked  leadership  and  coordination.    The  PD/IC  hired  two  parent 
educators"one  for  the  public  school  (full-time)  and  one  for  the  non-public 
school  (part  time).    Although  this  position  was  not  specified  in  the  FXP» 
the  parent  educators  performed  much  of  the  IC's  parent  involvement  role. 
This  reduced  program  costs  since  the  IC  commands  a  professional-level 
salary  yet  a  parent  educator  receives  a  paraprofessional-level  salary. 
The  public  school  parent  educator  was  a  very  competent  individual  who  had 
formerly  been  a  teacher  in  Mexico.    She  was  the  only  support  staff  person 
to  work  both  years  of  the  project.    The  non-public  school  parent  educator 
only  worked  part  of  the  first  year  because  of  the  contractor  questioning 
this  use  of  funds*    The  pro^ject  evaluator  was  a  bilingual  achool  psycho- 
logist and  was  assigned  to  the  project  only  ten  percent  of  his  time.  He 
had  never  evaluat&d  a  bilingual  program  before.    Difficulties  in  finding 
bilingual  testers  and  in  locating  control  group  students  took  more  time 
than  expected,  leaving  very  lJ^:tle  time  for  data  analysis  and  interpreta** 
tion. 

During  the  second  year,  the  IC  role  was  also  part  of  the  PD's  duties. 
Again  the  lack  of  elementary  and  bilingual  education  methodology  may  have 
weakened  the  ??D's  credibility,  but  it  seems  likely  that  the  administrative 
and  organizational  problems  had  a  larger  effect.    The  DFP  contracted  with 
an  outside  evaluator  who  was  an  experienced  evaluator  of  bilingual  programs 
but  who  lived  a  thousand  miles  away.    As  a  result,  the  evaluation  expertise 
was  improved,  but  the  time  devoted  to  the  task  and  the  interaction  between 
evaluator  and  staff  was  greatly  reduced.    The  public  school  parent  educator 
was  the  only  support  staff  member  who  remained  with  the  project  beyond 
the  first  year;  even  the  project  secretaries  changed. 

if^roject  instructional  staff.    Three  teachers  (Ts)  participated  in  the 
[iroject  the  first  year;  all  were  bilingual  and  two  were  blcultural.  Two 
Ts  were  competent  elementary  school  Ts,  but  one  was  a  high  school  Spanish 
T  without  elementary-level  experience.    The  second  year,  an  additional  T 
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was  hired;  this  T  was  bilingual  but  not  bicultural.    Ts  read  the  PIP 
Teacher's  Manual  but  found  it  irrelevant  to  daily  classroom  needs.    One  T 
had  worked  in  the  state^funded  bilingual  program  and  was  ui.ilerstandably 
reluctant  to  change  materials  and  methods »  but  all  Xs  received  and  even- 
tually used  PIP  core  materials.    Ts  snd  tescher  aides  (TAs)  did  not  re- 
ceive s  stsrt-up  workshop  the  first  year.    The  second  ye.ar  a  two-day 
preservice  workshop  was  held.    Various  in-service  sessions  were  held 
throughout  both  years;  most  of  these  were  general  TRC  workshops  or  con- 
ferences and  not  specifically  tailored  to  T  or  project  needs. 

It  was  difficult  for  the  district  to  find  TAs  with  college  course 
work  and  certificates  as  required  by  state  lav»  so  during  the  first  year 
three  high  school  graduates  were  hired  and  given  another  job  title. 
The  TA  at  the  non-public  school  was  monolingual  Spanish;  the  other  two 
project  aides  were  bilingual,  and  functioned  adequstely  in  the  classroom. 
Throughout  the  second  year  there  was  a  turnover  in  teacher  aides  and  some 
classrooms  remained  without  aides. 

Other  personnel  (regular  stsff,  conmunity,  parents).    The  principal 
of  the  project  school  had  to  accept  the  project  because  it  was  part  of 
the  district's  desegregation  plan.    However*  he  snd  the  school  staff  had 
previously  been  accustomed  to  an  all^hite  school  snd  at  first  viewed  the 
project  students  as  outsiders.    Poor  working  relations  existed  between 
the  first  year  PD  and  the  principal,  which  caused  delays  and  roadblocks 
for  project  sctivities  such  as  ordering  materisls  snd  conducting  inservice 
sessions.    Despite  sttempts  by  the  new  PO  to  establish  new  procedures* 
these  difficulties  continued  during  the  second  year.    In  some  cases,  reg- 
ular staff  and  project  Ts  shared  materials  and  students*  so  some  joint 
planning  did  occur.    As  the  project  became  better  known*  regulsr  staff 
begsn  to  respond  more  positively  to  project  students. 

The  Adelante  project  and  the  state  bilingual  project  held  regular 
meetings  for  parents,  some  of  which  were  open  to  community  people  as  well. 
Before  the  bilingual  projects  were  moved  from  the  segregated  to  the  all'^ 
white  school,  parents  were  consulted  about  the  move  and  invited  to  visit 
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the  new  school.    It  is  difficult  to  say  how  much  community  support  this 
represented  because^  once  the  move  was  made»  parent  complained  about  bus-* 
ing  and  launched  an  effort  to  return  the  bilingual  projects  closer  to  the 
community  they  served*    The  distinction  between  the  state  project  and 
Adelante  was  somevhat  blurred  in  the  minds  of  parents  because  meetings 
for  the  two  projects  were  held  jointly  and  because  the  two  projects  served 
adjacent  grades*    Both  the  public  and  non-public  schools  were  served  by  a 
parent  educator  who  made  home  visits  and  held  small  informal  meetings  in 
parents'  homes*    Parents  did  not  participate  in  the  classroom  to  the  ex- 
tent described  in  the  PIP;  project  staff  stated  that  the  distance  between 
the  school  and  the  community  made  such  participation  difficult*    At  the 
end  of  the  second  year»  district  DMs  decided  to  move  the  K-3  bilingual 
students  to  still  another  school*    Although  the  school  atmosphere  may  be 
more  supportive^  the  project  was  to  be  even  further  from  the  community* 
During  the  second  year»  parents  became  increasingly  aware  of  the  problems 
plaguing  the  project  and  became  more  active*    For  example^  the  project^'s 
move  to  a  new  school  was  precipitated  by  a  parents  meeting  with  the  dis- 
trict DMs* 

Other  resources  (materials/equipment^  facilities,  funds)*  Materials 
in  Spanish  were  already  available  in  the  district  because  of  the  existence 
of  the  state-funded  bilingual  progrsm*    The  new  project  funds  provided 
more  and  different  materials^  and  an  effort  was  made  to  have  all  the  Ade- 
lante teachers  use  the  same  core  materials*    However »  during  the  first 
year  one  T  preferred  and  continued  to  use  the  original  materials*  Many 
supplementary  and  enrichment  materials  were  purchased  with  project  funds* 
All  the  Ts  established  learning  areas  in  their  classes*  as  suggested  in 
the  PIP»  and  grouped  their  students*    School  facilities  were  adequate* 
The  biggest  disadvantage  was  the  distance  between  the  school  and  the  com- 
munity served  by  the  project*    The  PD  was  housed  in  the  school  rather  than 
in  the  district  office  as  the  PIP  suggests  but»  since  the  ?d  was  also  the 
ICt  the  office  assignment  was  appropriate*    One  possible  result  of  this 
arrangement  was  that'district-level  PD  functions  were  left  largely  to  the 
DFD*    The  district  had  terminated  several  hundred  Ts  because  of  financial 
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pressures  and  although  district  funds  were  adequate*  they  vere  not  sbun- 
dant*    The  financial  pressure  may  have  motivated  the  search  for  federal 
money  and  the  hiring  of  existing  district  personnel  even  though  some  did 
not  have  the  skills  specified  by  the  PIP* 

Plans  and  constraints*    The  district  was  under  a  state  direr'^ive  to 
desegregate*    A  state  bilingual  law  mandated  bilingual  educ  t  any 

level  vhere  there  were  20  or  more  LES  children  at  one  school*       ^le  VII 
regulations  also  applied*    Because  of  financial  constraints*  the  district 
implemented  a  number  of  administrative  measures*  such  as  limiting  travel 
to  conferences*  However*  some  of  these  measures  were  iu  conflict  with  Title 
VII  requirements*  and  required  some  adjustment* 

Students*    Although  they  were  never  administered  language  dominance 
tests,  project  staff  reported  that  most  students  were  Spanish  dominant* 
RMC  observations  can  only  confirm  the  presence  of  many  Spanish*speaking 
students*    Project  students  came  from  a  fairly  stable  population*  The 
Hispanic  community  was  a  small*  but  increasing  minority  in  the  ar^a*  Stu- 
dents vere  selected  for  the  project  because  they  qualified  for  the  state 
bilingual  project*  i*e**  they  were  limited  English  speaking  and  low  SES* 
Students  had  previously  attended  a  majority  Black/Hispanic  school*  There 
was  no  significant  change  in  classroom  procedure  as  a  result  of  changing 
from  the  state  to  the  Adelante  bilingual  project* 

Instructional  treatment*    There  vas  little  articulation  of  program 
goals  and  content  between  the  different  grade  levels  and  the  two  school 
systems*    Students  were  grouped  by  achievement  level  for  reading  but  not 
for  math*    At  the  parochial  school*  the  classroom  was  entirely  individual** 
ized*    Both  first  and  second  grade  teachers  provided  English  oral  language 
development  instruction  using  standard  materials;  this  instruction  was  dis- 
tinct from  the  reading  program*    Spanish  was  used  according  to  individual 
need*  but  in  decreasing  amounts  as  the  children  learned  more  English;  thuu 
math*  for  example*  was  taught  mainly  in  English  by  the  end  of  first  grade* 
During  the  first  year  the  project  consisted  of  one  kindergarten  and  one 
first  grade  classroom  in  a  public  an.^  one  mixed  level  class  in  a  parochial 
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school*    During  the  second  year  a  second  grade  class  was  added  at  the 
public  school* 

In  the  first  grade,  students  received  thirty  to  forty-five  minutes 
of  math  instruction,  sixty  to  ninety  minutes  of  Spanish  reading,  and  forty- 
five  to  sixty-five  minutes  of  English  language  arts*    Not  all  first  grade 
students  were  reading  in  English  by  the  end  of  the  year  but  most  of  the 
public  school  students  had  half  a  year  of  English  reading  instruction 
for  forty  minutes  daily*    Spanish  reading  was  continued  in  the  second 
grade  but  less  intensively*    No  schedule  waa  available  to  BMC  for  the 
second  grade* 
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ADELAHTE  *  SITE  D 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Settlnp*    Site  D  is  in  the  United  States  Trust  Territory  of  Puerto 
Rico*    All  of  the  students  were  Spanish  monolingual  and  lived  in  an  area 
from  which  many  families  traveled  to  and  from  the  continental  United 
States*    The  cwo  school  districts  participating  in  the  project  were  part 
of  a  large  metropolitan  area* 

Overview*    The  Spaulsh-speaking  environment  of  Puerto  Rico  was  a 
totally  different  setting  from  the  Adelante  PIP  origination  site*  Host 
Adelante  materials*  methods  and  teacher  training  practices  had  been  deV'^fl- 
oped  for  areas  where  Spanish  is  a  minority  language  and  English  is  the 
principal  language*    Because  Puerto  Rico  is  a  Spanish-*s peaking  society* 
everything  from  program  goals  to  development  of  materials  and  tests  had 
to  be  developed*    There  were  few  appropriate  materials  and  practices  to 
guide  the  EHs  in  setting  up  the  project  and  the  Adelante  pip  was  no  ex* 
ception* 

The  original  proposal  cslled  for  teaching  Spanish  to  English-^speaking 
students  returning  from  the  mainland*  but  it'was  difficult  to  concentrate 
these  students  in  any  one  school*    After  six  months  of  negotiating  with 
the  funding  agency*  the  goals  were  rewritten  so  that  Spanish-*s peaking 
children  could  be  taught  English*    The  students  were  to  become  bilingual* 
so  that  if  they  were  to  spend  any  time  oti  the  U*S*  mainlsnd*  their  educa* 
tion  would  be  only  minimally  disrupted* 

Decision  makers*    Two  levels  of  decision  makers  (DMs)  existed  at  this 
site»the  state  education  agency  (SEA)  staff  who  wrote  the  proposal  and 
administered  the  project*  and  the        at  the  two  local  education  agencies 
(LEAs)  where  the  project  was  housed*    A  change  in  SEA  directors  of  bilingual 
education  occurred  between  project  selection  and  start-up*  but  the  func- 
tion continued  to  be  performed  smoothly*    The  ASK  was  available  to  the  DMs 
and  the  TRC  had  sent  them  a  complete  PIP;  however*  the  PIP  project  they 
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applied  for  and  the  one  they  were  eventually  assigned  by  the  funding 
agency  were  different*    The  SEA  DHs  were  familiar  with  local  classroom 
prsceices  and  curriculum^  and  with  community  opinions*    They  were  inter- 
ested in  obtaining  funds  for  bilingual  education  hut  had  some  trouble 
fitting  the  laodel  projects  to  their  aeeds* 

DMs  saw  the  ASK  and»  at  their  request^  the  Nuevos  Horizontes  PIP* 
The  funding  agency  assigned  the  Adelante  PIP  and  zhe  original  proposal 
for  Nuevos  Horizontes  was  rewritten*    Neither  PIP  was  really  appropriate 
for  this  site*    They  needed  a  completely  different  models  which  did  not 
exist* 

LEA-level  administrators  were  very  cooperative  with  the  SEA  DMs^ 
partly  because  this  educational  system  is  fairly  centralized  and  hierar- 
chical*   District -level  personnel  did  not  have  the  experience  in  fund 
raising  or  in  administering  special  projects  independently  of  the  SEA* 
LEA  DMs  were  involved  at  the  time  the  initial  proposal  was  written^  but 
when  the  nature  of  the  proposal  changed »  this  LEA  was  dropped  by  the  SEA 
and  two  others  were  selected « 

Project  director*    The  project  director  (PD)  was  bilingual  and  Puerto 
Rican*    She  was  an  employee  of  the  SEA  and  the  evaluator  of  another  Title 
VII  project*    She  was  hired  very  late  because  the  project  start-up  was  d&*- 
layed  for  four  months  while  LEA  changes  were  made  and  project  goals  t^re 
negotiated*  She  was  not  familiar  with  the  Adelante  PIP  nor  the  proposal 
when  she  was  initially  assigned  to  the  position*    Although  she  worked 
closely  with  her  immediaite  supervisor »  who  assumed  some  of  the  PD  func- 
tions>  she  waa  effective  in  Implementing  the  project  given  the  many  con- 
straints existing  at  this  site* 

Project  support  staff.     The  support  staff  was  housed  at  the  SEA  of- 
fices>  which  were  located  fairly  close  to  both  LEAs  involved  in  the  proj- 
ect*   The  staff  worked  urder  and  cooperated  closely  with  the  SEA  director 
of  bilingual  education*      11  support  staff  members  were  bilingual  and 
Puerto  Ricat.*    The  instructional  consultant  (IC)  >  who  had  the  role  of  a 
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supervisor  of  teachers  In  addition  to  a  resource  teacher,  was  hired  sev- 
eral months  after  the  project  began*    He  had  no  previous  experience  in  bi- 
lingual education*  but  had  an  M*A*  in  the  teaching  of  English  as  a  Second 
Language  (ESL),  lAich  was  possibly  more  relevant  at  this  site*    The  SEA 
director  for  ESL  was  consulted  regularly  by  the  PD  and  IC  and  was  very 
interested  in  the  project*    Near  the  end  of  the  first  school  year,  an 
evaluator  was  hired  for  the  project  but  he  did  not  have  adequate  skills. 
He  Was  not  retained  ever  the  sijmmer  and  a  new  person  with  an  appropriate 
background  was  hired  for  the  second  year*    Since  no  suomtative  evaluation 
was  possible  the  first  year  due  to  lack  of  appropriate  tests,  not  having 
an  evaluator  did  not  present  any  problems*    The  fact  that  the  evaluation 
position  was  funded  at  a  half-time  level  made  filling  this  position  diffi- 
cult since  no  one  with  the  appropriate  skills  was  willing  to  work  part- 
time*    The  parent  liaison  position  written  into  the  proposal  was  never 
filled*    Those  funds  were  used  instead  for  the  development  of  appropriate 
tests*    Test  development  was  a  major  project  effort  paid  for  partly  by  the 
project  but  also  supported  by  SEA  technical  staff  and  consultants  from  a 
major  testing  cosipany*    SEA  and  project  staff  also  wrote  English  curriculum 
objectives  and  materials  to  complement  the  existing  Spanish  curriculum. 

Project  instructional  staff*    Although  the  project  teachers  (Ts) 
spoke  the  same  language  and  belonged  to  the  same  cultural  group  as  their 
students,  only  two  out  of  eighteen  were  bilingual*    The  Ts  were  respons- 
ible for  the  regular  Spanish^language  instruction;  bilingual  teacher  aides 
(TAs)  prepared  and  conducted  short  lessons  in  English  that  paralleled  the 
T's  regular  lesson*    The  TAs  had  lived  on  the  United  States  mainland  pre- 
viously*   About  half  were  university  students  with  an  interest  in  educa- 
tion and  were  continuing  to  work  towards  a  B*A,  degree  In  bilingual  edu- 
cation*   Ts  and  TAs  worked  well  together  and  planned  together  once  a 
week.    Because  of  the  particular  importance  of  the  aide  role  at  this  site, 
the  aides  received  a  week  of  pre-service  training  during  the  first  year, 
while  the  Ts  received  only  one  day's  training*    First  year  in-service 
training  consisted  of  a  discussion  of  the  Adelante  Teachers'  Manual— i^ich 
was  of  limited  relevance*— and  training  in  vocabulary  development  and  ESL 
in  the  content  areas*    Second  year  staff  development  began  with  a  needs 
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assessment  instrument  completed  by  all  Is  and  TAs  that  was  then  used  to 
plan  a  series  of  workshops  given  by  the  PD>  IG»  and  consultants* 

Other  personnel  (regular  staffs  community,  parents)*    The  regular 
staff  at  all  project  schools  was  composed  of  Spanish-speaking  Puerto 
Ricans*    The  project  staff  invited  regular  staff  to  participate  in  the 
project's  cultural  activities  and  shared  materials  and  equipment  with 
them*    The  principals  were  willing  to  help  the  project  staff  and  did 
not  interfere  with  daily  project  procedures  in  any  way* 

Parents  and  community  members  from  one  LEA  were  consulted  at  the 
time  of  proposal  writings  but  this  LEA  was  later  dropped  irom  the  project* 
Each  of  the  two  schools  in  the  project  held  regularly  scheduled  meetings 
with  parents  throughout  the  school  year*    During  the  first  year»  parents 
at  this  site  did  not  regard  helping  in  the  classroom  as  an  appropriate 
role;  they  participated  only  in  cultural  events  and  field  trips  to  which 
community  members  were  also  invited*    During  the  second  year»  parents' 
roles  changed  considerably*    They  volunteered  time  in  the  classroom»  as^ 
sisted  in  administering  and  correcting  tests»  made  recommendations »  and 
became  advocates  of  the  program  in  their  communities*  Engli&h^as-a^ 
second- language  (ESL)  classes  for  parents  were  organized  at  each  school* 
Many  parents  requested  the  program  for  their  children »  and  &o  program 
enrollment  increased* 

Other  resources  (materials/equipment,  facilities,  funds)*  Curriculum 
materials  suggested  in  the  Adelante  PIP  and  nost  standardized  tests  were 
totally  inappropriate  for  this  site*    Very  few  appropriate  commercial 
materials  existed*    An  extensive  pre-project  and  ongoing  local  materials 
development  effort  was  conducted*    Because  of  the  late  start»  almost  all 
materials  had  to  be  developed  by  the  TAs  after  they  were  told  what  mate- 
rial the  T  would  use*    Therefore,  the  materials  were  of  uneven  quality* 
By  the  second  year»  elaborate  teacher's  gui<fes  vere  being  developed  for 
Bngliah  instruction  in  the  content  areas,  paralleling  guides  already  exist- 
ing for  Spanish  instruction*    The  facilities  were  adequate  by  local  stan* 
dards,  but  some  rooms  were  very  crowded*    This  made  it  difficult  to  work 
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in  sniall  groups  or  to  use  learning  centers*  although  this  occasionally 
did  occur* 

Plans  and  conatrainta*    A  major  constraint  was  the  large  difference 
in  context  between  this  site  and  most  other  Title  VII  sites*  Materials* 
procedures*  and  instructional  approaches  that  were  appropriate  for  Spanish 
speaking  students  in  the  continental  United  States  were  siiuply  not  appro- 
priate for  Puerto  Rico*    Most  of  what  the  PIP  specified  also  needed  exten* 
sive  modification*    During  the  first  year,  it  was  impossible  to  follow 
Title  VII  evaluation  requirements  at  this  site  because  of  the  absence  of 
adequate  tests*    This  was  in  part  due  to  the  local  practice  of  not  testing 
kindergarten  through  second  grade  students*    By  the  ead  of  the  second  year 
locally  appropriate  tests  had  been  developed  and  control  groups  had  been 
identified  and  tested*    Some  modification  of  the  instruments  was  expected 
after  detailed  analysis*    LSA  regulation  prevented  Ts  from  being  released 
during  class  time*    This  made  it  impossible  to  follow  the  PIP  guidelines 
for  in*service  training*    However,  since  the  TAs  were  responsible  for  bi~ 
lingual  instruction,  the  lack  of  time  available  for  training  Ts  was  not 
crucial  at  thia  site* 

The  project  schools  were  part  of  a  highly  consistent  and  centralized 
educational  system*    An  area*wide  ESL  plan  existed  covering  all  grades* 
Other  areas  of  the  curriculum  were  also  covered  by  systematic  curriculum 
plans* 

Students*    Project  students  were  Spanish  monolingual  and  totally 
like  non-project  students*    Project  schools  were  chosen  hecause  they 
were  located  in  an  area  of  relatively  frequent  movement  between  that 
neighborhood  and  the  continental  United  States*    Within  the  three  proj* 
ect  schools^  all  students  at  the  appropriate  grade  level  were  enrolled 
in  the  project*    Absenteeism  was  fairly  high  at  one  school* 

Instructional  treatment*    The  content  of  instruction  in  all  subject 
areas  was  guided  by  S&A-developed  curriculum  and  by  a  standardized  use 
of  textbooks  and  therefore  varied  little  across  classrooms*  Although 
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students  were  occasionally  grouped »  most  instruction  involved  the  whole 
class  in  a  single  activity* 

Prior  to  the  project*  intruction  had  been  conducted  in  Spanish*  with 
one  hour  of  ESL  per  day*    The  project  added  English-speaking  aides  to  all 
the  classrooms*  and  each  lesson  in  a  content  area  was  followed  by  a  ten» 
to  fifteen-minute  lesson  in  English^  reinforcing  the  same  concepts  that 
had  been  taught  in  Spanish*    The  project  also  contributed  a  cultural  com- 
ponent that  included  the  study  of  local  and  United  States  culture^  There 
were  field  trips  and  other  sctivities  in  which  the  parents  also  partici- 
pated*   All  students  continued  to  receive  an  hour  ESL  class  with  another 
teacher*    Classes  usually  did  not  have  audiovisual  equipment  or  activity 
sreas^  but  demonstration  objects  and  teacher^msde  materials  were  frequently 
used^    The  project^  which  was  housed  in  three  schools^  consisted  of  six 
kindergartens  and  six  first  grade  classes  the  first  year  and  six  second 
grade  classes  were  added  the  second  year^ 

First  and  second  grade  students  followed  the  same  schedule^  They 
had  ninety  minutes  of  Spanish  reading  and  language  arts  and  sixty  minutes 
of  ESL*    Math»  social  studies »  and  science  were  taught  for  thirty  to 
forty**five  minutes  in  Spanish »  each  followed  by  a  fifteen  minute  session 
in  English  reinforcing  the  same  content  area* 
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NUEVOS  HORIZONTES  -  SITE  A 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Setting*    This  site  is  located  in  a  large»  urban  community  and  is 
one  of  the  largest  school  districts  in  the  country*    It  has  55  elementary 
schools^  15  junior  high  schools  and  eight  high  schools*    The  elementary 
school  enrollment  is  31»532  students*    An  estimated  32%       the  districts 
61»517  students  are  minorities*    About  seven  percent  of  district  pupils 
are  classified  Limited  English  Proficiency  and  nearly  one  percent  are 
Non^English  Speaking*    An  estimated  67%  of  these  students  are  enrolled 

*  elementary  school*    Minority  enrollment  in  the  district  increased  from 
13X  to  the  present  32X  in  ten  years,  of  which  11*5X  was  Hispanic*  Hispanic 
enrollment  increased  to  this  present  level  from  4*5X  of  the  total  district 
enrollment  ten  years  ago*    Hispanics  comprise  13*0%  of  the  elementary  en- 
rollment and  10*7%  and  9*4%  of  the  Junior  high  and  high  school  enrollment, 
respectively* 

Overview*    This  site  had  been  alleged  as  being  out  of  compliance  by 
OCR  the  previous  year  and  viewed  the  PIP  project  as  one  way  to  get  back 
into  compliance*    They  made  a  major  attempt  to  replicate  the  PIP  faith- 
fully* 

Decision  makers*    This  site  wss  a  highly  sophisticated  district  with 
a  definite  chain  of  command*    The  superintendent  and  school  board  were 
Anglo  and  spoke  no  Spanish*    This  site  had  a  history  of  submitting  Title 
VIX  proposals  since  1973,  but  their  fairly  low  N/LES  count  was  the  cause 
of  their  not  being  funded  previously*    The  school  board  and  the  district 
as  a  whole»  while  not  overly  enthusiastic  about  bilingual  education^  were 
willing  to  try  it»  believing  that  it  may  help  children*    Althoug^h  the 
ethnic  composition  of  the  school  board  did  not  change  the  second  year, 
they  continued  to  support  the  program* 

In  Site  A  the  superintendent  encouraged  the  director  of  the  non- 
Englieh^language  projects  in  the  district  to  seek  out  sources  of  funding. 
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especially  Tide  VII »  and  co  submit  proposals*    This  director  vas  compe- 
tent and  influential  in  his  area*    He  vas  first  informed  of  the  PIPs  by 
the  TRC  at  a  county-wide  meeting*    The  tSLC  visited  the  district  at  the 
director's  request  and  shoved  him  and  three  potential  targe t**school  prin- 
cipals and  the  entire  Analysis  and  Selection  Kit  (ASK)  with  slides  and 
tapes*    The  TRC  offered  their  continued  help*    They  loade  the  PIP  manuals 
available  for  a  half-day  while  the  district  was  writing  their  Title  VII 
proposal* 

The  director  delegated  work  to  the  district  bilingual  coordinator* 
who  was  bilingual/bicultural»  and  very  knowledgeable  in  bilingual  educa- 
tion*   Both  the  director  and  the  coordinator  had  a  good  working  relation** 
ship  with  the  community*    The  project  ran  smoothly  throughout  the  differ* 
ent  phases  as  far  &8  the  decision-makers'  activities  and  policies  were 
concerned* 

Project  director*    The  project  director  (PD)  was  hand-picked  by  the 
director  of  non-English-language  projects  and  the  bilingual  coordinator* 
She  had  the  PIP-specified  qualif ications»  was  enthusiastic  and  hardwork- 
ing»  and  had  the  necessary  teaching  and  administrative  experience  to  be 
PD*    The  PD  at  this  site  faithfully  attempted  to  replicate  the  Nuevos 
Horizontes  model*    She  kept  very  frequent  contact  with  the  district  eval* 
uation  unit  and  believed,  as  they  did,  that  when  the  district  accepted 
Title**VlI  funding,  they  also  agreed  to  replicate  the  PIP  project*  She 
made  every  possible  effort  not  to  deviate  from  the  PIP  and  consulted  the 
manuals  so  much  that  ^e  practically  had  them  memorized*    For  both  yeara^ 
she  joined  the  project  during  the  summer  on  a  half-time  basis  to  organize 
it*    She  shared  an  office  with  the  district  bilingual  coordinator  and  fre 
quently  discussed  the  project's  operation  with  the  coordinator  and  with 
her  supervisor,  the  director  of  non-English- language  programs*    She  was  a 
effective  PD  and  had  so  much  interest  in  the  project  that  she  telephoned 
the  developer  site  to  obtain  as  much  information  about  the  program  as  she 
could*    Several  principals  and  teachers  commented  that  she  was  exactly 
like  the  PIP-described  PD* 
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Project  support  staff.    At  OBE's  request  the  district  at  the  last 
moment  added  a  fourth  school  to  the  project  because  the  developer  site 
had  four  schools.    This  required  a  reallocation  of  the  budget  and  pre- 
vented the  site  from  hiring  an  Instructional  coordinator  (IC)  until 
January.    The  PD  both  filled  the  PD  and  IC  roles  until  the  IC  was  hired. 
The  IC  had  the  PlP-speclf led  skills  and  knowledge*  but  lacked  the  neces- 
sary assertlveness  needed  to  be  an  IC*    However*  the  PD  worked  closely 
with  the  IC  so  this  presented  no  problems.  The  second  year  the  s'fte 
had  adequate  funds  and  were  able  to  hire  a  full-*tlme  IC.    The  district 
had  Its  own  evaluation  unit  and  all  evaluation  was  internal.  The  project 
also  had  a  part-time  community  coordinator  that  performed  PlP-speclf led 
liaison  functions  between  the  project  and  the  community.    It  was  a  non- 
certificated  position  and  In  the  two  years  of  project  operation,  three 
different  persons  successively  occupleu  th£.  position. 

Project  Instructional  staff.    The  project  teachers  (Is)  and  teacher 
aides  (TAs)  were  bilingual  and  somewhat  blllterate  and  had  all  the  PIP- 
speclfled  skills.    The  first  year,  some  Ts  and  all  TAs  were  blcultural 
even  though  the  PD  Indicated  that  bilingual  TAs  were  difficult  to  find. 
Not  all  TAs  were  blcultural  the  second  year  but  all  met  the  Lau  criteria 
of  linguistic  proficiency  and  cultural  awareness.    The  majority  of  Ts 
the  second  year  were  able  to  teach  bilingual ly,  but  they  varied  In  their 
degree  of  Spanish  fluency.    Both  the  district  bilingual  coordinator  and 
the  PD  &at  In  on  the  Interviewing  of  staff  candidates  In  one  school  at 
the  request  of  the  new  principal,  but  due  to  district  policy  did  not  make 
the  final  hiring  decisions.    For  the  second  year,  the  PD  was  given  the 
responslbllty  of  assessing  the  aides'  language  proficiency  by  administer^ 
Ittg  language  assessment  tests.    In  two  target  schools,  the  principals 
either  used  bilingual  Ts  they  already  had,  transferred  a  bilingual  T  from 
another  school,  or  hired  them.    Both  years  all  Ts  were  hired  in  time  to 
attend  the  start-up  workshop;  TAs  did  not  start  to  work  until  the  first 
day  of  school,  but  this  presented  no  problem.    Although  TAs  did  not  at- 
tend the  start-up  workshop  they  were  provided  many  inservice  training 
sessions  during  the  school  year  by  the  PD.    The  PD  gave  all  Ts  a  copy  of 
the  Teacher's  Manual  and  requested  not  only  that  they  follow  the  manual 
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but  they  write  problemSi  reactionsi  etc.|  in  it.    This  was  the  one  site 
where  Tb  realized  they  were  trying  to  replicate  a  PIP  project »  where  they 
knew  the  information  in  the  Teacher^ b  Manual  and  where  the  Teacher^ b  Manual 
Bhowed  use. 

Other  perBonnel  fregular  Btafft  community,  parentB).    The  PD  and 
principalB  tried  to  orient  and  involve  the  regular  Btaff  in  workBhopB. 
There  waB  no  jealouBy  between  the  BtaffB  as  the  non-project  staff  tended 
to  view  the  Title  VII  Btaff  aB  having  a  lot  more  work  to  do  inBtead  of 
Beeing  them  aB  receiving  more  materialB  and  attention. 

There  never  had  been  a  great  deal  of  parent  and  community  inn^olvement 
with  the  BchoolB,  and  project  implementation  did  not  change  thiB.  ThiB 
was  due  in  part  to  Bome  principalB  who  viewed  parental  Involvement  aB 
rather  burdenBome  due  to  the  fact  that  parentB  do  not  have  telephoneB^ 
are  tranBient^  etc. 

There  were  parent  advisory  committee  monthly  meetingB^  howeveri  and 
the  principalB  did  attend  them.    ParentB  had  no  negative  reBponBeB  to  the 
program. 

Other  reBourceB  (materialB/equipmentt  facilitieBt  fundB)*    The  firBt 
year,  the  PD  and  diBtrict  bilingual  coordinator  ordered  materialB  BuggeBted 
in  the  PIP  and  diBtributed  them  appropriately.    Yet  theBe  materials  arrived 
late  for  cwo  reasons;    the  PIPb  did  not  indicate  federal  regulations  re- 
garding the  use  of  Title  VII  monies  for  purchasing  materials  and  some  con- 
fusion occurred  resulting  in  a  late  ordering  of  some  materials;  second, 
some  PlP-^recommended  materials  were  out  of  print  or  bad  different  price 
lists,  or  the  district  textbook  catalogue  needed  to  be  updated.    This  late 
arrival  of  materials  did  not  cause  instruction  to  suffer.    The  second  year 
the  ordering  of  materisls  went  smoothly.    Some  PIP  materials  were  ordered, 
but  they  were  viewed  primarily  as  supplementary  materials.    Some  materials 
were  developed  by  Ts  during  the  in-^services .    While  the  age  of  the  schools 
varied,  all  were  comfortable  and  well  equipped. 
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During  the  first  year,  QBE  asked  the  site  to  Include  a  fourth  school 
to  duplicate  the  developer  site  pattern  of  four  schools  yet  did  not  allo- 
cate additional  funds.    This  resulted  In  fewer  funds  to  hire  s  full-time 
IC. 

Plsns  and  constraints.    Project  staff  really  tried  to  replicate  the 
PlP.    There  were  district  policies  operating  that  constrained  the  role  of 
the  PD.    For  example*  the  PD  did  not  hire  the  Ts  nor  evaluate  them.  At 
the  beginning,  this  resulted  In  the  PD's  spending  little  time  In  the  class- 
rooms because  she  was  concerned  that  the  Ts  might  view  her  as  evaluating 
them.    The  PD  worked  closely  with  the  district  evaluation  unit  to  develop 
detailed  performance  objectives  and  ways  of  assessing  them.    The  PD  used 
the  PIP  as  a  checklist  throughout  the  year. 

Students.    Modt  students  In  the  project  classrooms  were  LES.  During 
the  first  year,  children  placed  In  the  classes  were  selected  on  the  basis 
of  langusge  Proficiency  by  the  principal  and  Ts.    In  the  second  year,  se*- 
lectlon  procedures  were  based  on  three  steps;    (1)  Identification  of  stu- 
dent language  dominance  by  a  home  survey  form,  (2)  parental  permission  for 
participation  In  the  program,  and  (3)  Bilingual  Syntax  Measure  scores  In 
English  and  Spanish.    Children  were  similar  In  ability  to  non-'project 
children  In  the  district  and  tended  to  be  a  reportedly  transient,  urban 
population. 

Instructional  treatment.    All  project  teachers  In  grades  1  and  2 
spoke  English  and  Spanish  and  were  effective  teachers.    All  aides  were 
bilingual  and  workea  with  children  reinforcing  lessons  presented  by  the 
teacher.    Children  were  grouped  as  suggested  by  the  PIP,  on  the  basis  of 
language  proficiency  and  academic  needs.    There  were  four  kindergarten  and 
four  first  grade  classes  in  the  first  year  of  the  project.    Four  second 
grade  classes  were  added  tV.a  second  year. 

Reading  and  language  arts  were  regarded  as  distinct  subjects  at  this 
project  site.    In  grade  one,  students  were  taught  to  read  in  their  dominant 
language.    Reading  in  the  second  language  was  introduced  when  individual 
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students  exhibited  a  readiness  for  this  instruction*    Some  children  learned 
to  read  in  both  languages  in  first  grade»  but  the  majority  waited  until 
second  grade  for  second  language  reading  instruction*    Children  vere 
grouped  by  language  dominance  and  *Weds  level'*  for  reading »  language  arts 
and  math*    Concepts  vere  introduced  in  the  students'  native  language  and 
were  reinforced  in  their  second  language*    Children  also  had  ESL  or  SSL 
instruction*    In  general*  instruction  vas  satisfactory*    The  use  of  Spanish 
and  English  instruction  was  varied  throughout  the  day»  and  both  teachers 
and  children  were  free  to  use  the  language  of  their  choice  for  clarifica-* 
tion  and  social  communication*    Some  children  in  both  grades  one  and  two 
als^  attended  pullout  £5^ »  English  reading  and  English  math  labs  funded 

non^Title  VII  funds*    These  labs  were  taught  by  specialist  teachers 
to  children  who  needed  extra  help  in  these  subjects*    Children  vent  as 
individuals  and  in  small  groups*    The  labs  operated  for  different  periods 
of  time  such  as  a  3-veek  basis  to  several  months  duration* 

Instructional  time  for  reading  and  language  arts  varied  across  class- 
rooms with  an  average  of  thirty  minutes  daily  for  language  arts  and  an 
hour  daily  for  reading*    Math  instruction  occurred  for  approximately 
thirty  minutes  daily* 
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MUEVOS  HORIZONTES  -  SITE  B 

PROJECT  SUMMARY 
1977-1978  and  1979 

Settlnjg.    This  site  is  a  very  small*  isolated  rural  district  located 
in  a  sparsely  populated  area.    The  city  hss  a  population  of  2»738  and 
the  district  student  enrollment  was  966  students.    An  estlinated  58%  of 
the  K-2  student  enrollment  was  comprised  of  students  having  a  limited 
English-speaking  ability.    Forty  percent  of  the  school  population  was 
comprised  of  Chicanos»  most  of  whom  were  poor  and  migrant. 

Overview.    Although  this  site  had  received  state  funds  for  a  bilin- 
gual program  in  previous  years,  little  or  nothing  in  the  way  of  a  bilin- 
gual urogram  had  ever  been  developed.    The  district  had  a  migrant  educa- 
tion progrr^  for  the  previous  ten  years,  yet  it  had  no  effect  on  student 
achievement  at  all.    While  the  support  staff  was  positive  towards  the 
program,  the  administration  and  project  teachers  were  skeptical.  All 
ni  e  of  the  district's  K-1  und  2  classes  in  this  site  participated  in 
the  project.    However,  not  all  children  in  these  classes  participated. 

Decision  makers.    Site  B  was  such  a  small  district  that  there  were 
only  three  decision  tnakers  (DHs):    th^  superintendent,  the  director  of 
federal  projects  (DFP),  and  the  principal  of  the  elementary  and  secondary 
school.    The  DHs  and  school  board  were  Anglo  and  spoke  no  Spanish.  Bilin- 
gual education  waf*  not  seen  as  a  need  in  this  district.    The  majority  of 
the  town's  population  waa  Anglo  and  apoke  little  or  no  Spanish. 

The  DFP  had  bee*^  in  the  district  for  many  year^,  yet  the  superinten- 
dent had  been  there  Just  one-and*a-half  years.    The  DFP  knew  very  little 
about  bilingual  education,  or  about  writing  proposals  for  Title  VXI  funds, 
but  she  knew  their  non-English  speaking  (NES)  and  limited  English-speaking 
(LES)  populatl-in  need     help  4.  i  felt  bilingual  education  might  provide 
that  help.    She  attended  a  meeting  hosted  by  the  state  educational  agei'^y 
(SEA)  and  saw  the  PIP  manuals  there.    She  then  hired  a  consultant  and 
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together  they  wrote  a  Title  VXX  proposal^  which  was  subsequently  funded* 
She  was  not  effective  during  initial  budget  negotiations »  which  resulted 
in  ;f asuf ficient  money  allocated  for  program  operation*  Start-up  activi- 
ties did  not  begin  until  August*  According  to  the  DPP^  the  reason  for 
this  delay  was  that  there  had  been  no  contacts  from  OBE  prior  to  that  time* 
While  DHf  took  little  action  the  whole  first  year^  they  did  not  actively 
block  the  project's  progress  either* 

Project  director*    The  first  year>  the  DMs  had  trouble  finding  a  proj- 
ect director  (PD)  and  the  superintendent  contacted  someone  he  had  worked 
with  in  another  district*    This  person  was  bilingual/bicultural  and  had 
the  childrens'  interest  at  hearty  but  he  lacked  a  real  understanding  of 
the  technical  issues  in  bilingual  educati^     and  expe.*ience  or  training 
in  the  field*    Fortunately^  there  was  an      itructional  coordinator  (IC) 
who  was  experienced  in  bilingual  education  L^d  who  saw  that  the  PD's  duties 
were  fulfilled*    The  PD  was  not  hired  until  August  and  the  IC  until  Sep- 
tember*   This  resulted  in  them  not  attending  the  district's  pre-service 
workshop^  not  selecting  staffs  and  not  ordering  the  core  materials*  One 
problem  that  the  PD  and  iC  encountered  was  the  lack  uf  an  established  power 
base*    This  was  the  first  time  in  that  town  that  a  Chlcano  had  a  position 
of  authority*    Both  the  PD  and  the  IC  were  therefore  hesitant  to  anger  or 
wrest  power  f"  t  the  DFP*    The  PD  believed  he  had  the  entite  fiVe-year 
funding  pe; -      cO  start  up  the  program*    For  this  reason*  among  others^ 
little  was  accomplished  during  the  first  year* 

The  second  year  the  PD  accepted  another  job  elsewhere  and  the  IC 
assumed  the  PD  position*    Because  this  new  PD  was  experienced  in  bilingual 
education  and  already  had  spent  one  year  with  the  project^  everything  ran 
smoothly* 

Project  support  staff*    During  the  first  year>  the  only  support  staff 
was  the  IC*    He  did  an  adequate  job^  given  the  fact  that  ne  was  also  the 
project  eValuator  and  assumed  many  PD  duties*    The  second  year  the  project 
hired  a  fuil-time  demonstration  teacher  funded  by  Title  VII*    She  was 
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d  trained  and  experienced  bilingual  T  and  supportive  of  the  project.  She 
gave  demonstration  lessons  during  classtime  for  the  Ts  and  TAs.    She  also 
taught  science  in  English  and  Spanish  and  performed  some  IC-type  duties • 
Overall  she  was  an  effective  demonstration  teacher. 

Project  instructional  staff.    This  site  was  unable  to  recruit  quali- 
fied bilingual  teachers  (Ts)  for  a  number  of  reasons:    recruitment  did 
not  begin  until  July;  the  site  was  small  and  isolated;  and  the  pay  scale 
was  low.    The  district  did  not  make  a  serious  effort  to  fill  two  existing 
vacancies  with  bilingual  Ts.    As  a  consequence,  all  of  the  project  Ta 
were  Anglo  and  spoke  no  Spanish.    They  knew  some  vocabulary  and  siiiq}le 
sentences  but  were  far  from  fluent*  bilingual*  or  able  to  teach  in  a  bi- 
lingual classroom.    At  the  start  of  the  year  the  staff  did  not  believe 
in  bilingual  education  but  favored  ESL.    They  regarded  the  n/LES  children 
as  slow  learners  and  did  not  regard  their  problems  as  being  languages-related. 
As  they  saw  the  children  Improving,  they  changed  their  attitude  somewhat. 
Both  the  young,  inexperienced  first-year  Ts  and  the  Ts  who  had  taught 
for  many  years  lacked  basic  teaching  skills.    The  IC  presented  inservice 
workshops,  but  Ts  rar^^ly  attended.    He  worked  on  the  teacher  aides'  (TAs) 
Spanish  literacy  so  they  could  teach  Spanish  reading  and  oral  language 
development.    Aides  attended  Spanish  literacy  classes  for  17  weeks  for 
three  hours  a  week  at  a  community  college  25  miles  distant*    In  this  iso- 
lated location*  Ts  had  little  motivation  to  go  beyond  the  bare  minimum 
in  teaching  or  to  seek  training  to  upgrade  their  skills*    Each  T  in  grades 
K  and  I  had  a  half-time  TA  that  was  bilingual  and  bicultural  but  not  bili- 
terate.    There  were  only  two  TAs  thac  were  shared  by  three  Ts  in  second 
grade.    These  TAs  taught  Spanish  and  English  reading  in  two  reading  centers 
all  morning  long.    It  was  the  responsibility  of  the  TAs  to  instruct  the 
N/LES  students  in  Spanish  reading,  Spanish  language  development,  English 
as  a  second  language,  and  to  teach  the  FES  student  Spanish  as  a  second 
language.    None  of  the  TAs  had  any  education  beyond  high  school  and  none 
had  previous  training  or  experience  in  the  classroom.    During  the  second 
year,  there  was  more  contact  between  the  T  and  the  students  due  to  the 
development  of  a  differentiated  staffing  model  wh^re  the  Ts  and  TAs  worked 
with  all  students  in  different  groups. 
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Other  personnel  (regular  staff >  community,  parents).    In  this  site,  ^ 
other  persons  played  very  minor  roles*    Since  the  project  encompassed  all 
K  and  1  and  2  classes  In  the  district,  there  were  no  non-project  Is  at  K, 
1,  or  2       provide  Input  on  problems.    The  most  common  attitude  among 
upper-^gradici  Is  was  that  bilingual  education  was  a  type  of  remedial  program. 
The  Anglo  and  Chlcano  groups  within  che  community  did  not  communicate  much 
with  each  other  nor  with  the  district  staffs    The  community  was  comprised 
mostly  of  farmers  and  migrant  agricultural  workers.    Toward  the  end  of  the 
first  year,  Chlcano  parents  were  becomi''^  Interested  In  the  program,  and 
many  were  attending  parent  advisory  committee  meetings.    During  the  second 
ye^r>  many  Anglo  parents  became  very  Interested  In  their  children  learning 
Spanish* 

Other  resources  (materials/equipment,  facilities,  funds).    Since  this 
site  had  received  state  funds  for  two  years  prior  to  receiving  Title  VII 
funds,  they  had  some  bilingual,  state-endorsed  textbooks.    However,  since 
no  specific  program  had  been  functioning  during  those  two  years,  the  Ts 
had  not  used  and  did  not  know  how  to  use  these  materials. 

When  the  BFF  contacted  the  SEA  during  selection/adoption,  she  was 
asked  If  she  were  willing  to  purchase  a  Spanish-English  reading  and  lan- 
guage arts  series  and  volunteer  to  pilot  the  series.    She  felt  It  was 
a  mandate  and  agreed  to  It  despite  the  fact  that:    the  site  already  had 
materials  for  a  comprehensive  bilingual  reading  project  purchased  with 
state  funds;  she  was  not  sure  that  the  new  program  would  be  an  improvement 
or  even  appropriate  for  their  students;  and  Itn  cost  represented  almost 
the  entire  budget  allocation  for  project  materials.    The  site  purchased 
the  new  series,  was  never  contacted  to  pilot  It,  and  the  new  PD  and  IC 
found  It  to  be  less  appropriate  than  the  reading  series  they  already  had. 
This  new  series  was  used  only  as  supplementary  material.    The  purchase 
of  this  material  meant  that  the  site  was  unable  to  purchase  other  neede^l 
bilingual  materials. 

Facility  locations  caused  a  problem  In  this  site.    The  K  classes 
were  located  across  town.    This  facility  was  a  dark  concrete  building 
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that  hdd  been  used  previously  for  the  Black  children  before  desegregation. 
Children  in  these  classes  were  bused  across  town  daily  to  the  district 
cafeteria  for  lunch.    Almost  an  hour  of  instructional  time  was  lost  daily 
in  transporting  students.    The  first  and  second  grade  classes  were  located 
in  the  1-^12  school.    Project  classrooms  were  sufficiently  large»  well  lit 
and  appropriate  for  instruction. 

Because  the  project  budget  was  reduced  during  negotiations »  the  proj*- 
ect  did  not  have  enough  funds  to  hire  a  community  coordinator.  Therefore» 
the  PD  and  IC  had  to  perform  the  community  coordinator's  duties.  These 
activities  got  off  to  a  slow  start  because  the  PD  had  just  moved  to  town 
in  August  and  the  I.C.  moved  to  town  in  November.    But  as  the  year  pro- 
gressed and  they  became  more  scquainted  with  the  community »  they  were  more 
effective. 

When  the  site  submitted  the  initial  proposal*  they  requested  that 
all  classes  in  K,l,2  be  funded.    They  received  funding  in  August,  1977 
f>r  only  grades  K  and  1  in  order  to  conform  to  the  NueVos  Horizontes  PIP  _ 
which  encompassed  only  K  and  1  during  the  first  year  of  operation.  When 
the  budget  was  negotiated  it  was  reduced  to  the  extent  that  they  were  un* 
able  to  hire  a  community  coordinator.    Since  the  budget  was  not  approved 
until  August,  this  resulted  in  a  late  ordering  of  materials.    In  addition, 
as  previously  mentioned,  most  of  the  funds  i^llocated  for  materials  were 
used  to  purchase  one  reading  and  language  series  and  other  areas  of  the 
curriculum  were  left  wanting.    Because  OBE  insisted  that  the  DFP,  PD  and 
IC  attend  an  OBE  meeting  in  Washington  in  August,  there  were  not  sufficient 
travel  funds  remaining  for  th^  to  attend  training  conferences  the  rest 
of  the  year.    All  of  these  expenditures  left  almost  no  money  in  the  budget 
for  operating  costs.    During  the  second  year  when  the  project  expanded 
to  second  grade,  there  were  no  probl^s;  sufficient  funds       e  budgeted 
for  the  project.    They  were  able  to  order  PIP  recommended,  core  material 
as  well  as  additional  supplementary  materials. 

Plans  and  constrfifits.    This  district  had  so  fw  written  policies 
that  nothing  really  constrained  thfi  project  implementation.    Because  of 
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the  isolated  geographic  location  and  lack  of  knowledge  and  experience  in 
dealing  with  bilingual  education*  they  were  not  particularly  aware  of 
nor  could  they  adequately  deal  with  the  plans  and  constraints  of  funding 
and  project  guidelines  beyond  the  most  blatant  ones. 

Students.    The  program  served  approximately  126  students  the  first 
year  and  240  the  second  year.    The  majority  of  them  were  from  Spanish* 
speaking  homes  and  had  parents  who  were  migrant  faraworkers •    While  some 
of  the  students  were  permanent  residents*  those  that  were  classifJled  as 
migrants  often  re-entered  this  site  two  and  three  times  a  year.    Most  of 
the  children  spoke  some  English  and  those  who  were  truly  N£S  were  mostly 
new  arrivals  from  Mexico  and  migrant  farm  workers.    The  students  were  of 
average  ability  as  judged  by  achievement  scores.    However*  at  the  start 
of  the  year*  these  students  were  considered  to  be  below  average  ability 
by  the  staff  because  they  were  grouped  on  the  basis  of  English  language 
achievement* 

  Instructional  treatment.    District  policy  stressed  reading*  language 

arts,  and  math  as  priority  subjects.    During  the  project  s  second  year* 
science  was  offered  for  the  first  time  in  the  district;  it  was  taught  in 
the  second  grade  by  the  project's  resource  teacher.    Science  lessons  were 
presented  in  English  and  Spanish.    Although  several  teachers  have  completed 
a  number  of  college  hours  in  Spanish  and  have  received  the  state  certifi* 
cation*  most  were  not  adequately  fluent.    Thus*  the  bilingual-bicultural 
aides  were  responsible  for  all  of  the  instruction  in  Spanish.    All  the 
Ts  assigned  their  TAs  the  responsibility  for  the  Spanish  component  of 
the  program.    This  often  resulted  in  N/LES  students  having  more  exposure 
to  the  TA  than  the  T.    Ifowever*  some  teachers  did  attempt  to  present  some 
lessons  in  Spanish  to  small  groups.    The  first  year  some  Ts  had  a  very 
tra<^^tional  classroom  with  no  grouping  by  achievement;  children  sat  in 
rows.    Some  K  classes  were  focused  around  television  programs  such  as 
Sesame  Street;  in  one  class*  no  open  books  were  observed  during  any  of 
several  visits.    The  second  year*  teachers  were  more  flexible  in  their 
classroom  management  style  and  began  to  use  reading  centers*  grouping 
techniques*  etc.    A  few  classes  had  learning  centers*  bat  these  were  used 
minimally • 
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Tv'^.ading  and  language  arts  were  interrelated.    In  first  grade  chil- 
dren identified  as  English  monolingual*  Fnglish-dominant*  or  bilingual 
learned  to  read  in  English.    A  few  children,  who  were  ready,  were  also 
taught  to  read  in  Spanish.    Spanish  monolinguals*  and  Spanish-dominant 
children  learned  to  read  in  Spanish.    lu  second  grade*  children  received 
reading  instruction  in  both  Isnguages.    Heading  and  language  arts  were 
taught  in  small  groups  at  reading  centers  within  each  classroom.  Groups 
were  instructed  by  the  teacher  or  the  aide*  depending  on  the  language 
of  instruction,    ^£ath  was  taught  in  English  by  the  teacher  to  the  entire 
class.    Children  who  did  not  understand  the  English  math  lesson  were 
tutored  in  Spanish  by  the  aide.    Children  classified  as  migrant  went  to 
the  migrant  center  every  day  for  thirty  minutes  of  instruction  in  ESL 
or  in  English  oral  language  development. 

The  entire  morning  of  each  day  was  devoted  to  reading  and  language 
arts  for  all  children.    Spanish  monolinguals  and  Spanish-dominant  children 
spent  one  hour  or  more  learning  to  read  in  Spanish  with  the  aide  in  grade 
one.    English  monolinguals,  English-dominant,  and  bilingual  children  re- 
ceived language  arts  and  reading  in  English  with  the  teacher  during  a 
period  covering  two  hours.    They  worked  in  small  groups  or  did  individual 
work.    In  second  grade*  the  aide  spent  one  hour  teaching  reading  in  Span- 
ish to  Spanish  monolinguals  and  Spanish-dominant  children.    These  children 
also  spent  thirty  minutes  each  morning  with  the  aide  learning  to  read  in 
English.    The  English  monolinguals*  English-dominant,  and  bilingual  chil- 
dren spent  the  morning  working  with  the  teacher  in  small  groups  or  working 
individually. 
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NUEVOS  H0RI20NTES  -  SITE  C 

PROJECT  SUMMARY 
1977^1978  and  1973-1979 

Setting*    This  site  la  located  In  a  major >  highly  urbanized  metropol* 
Itan  area*    It  receives  students  from  three  adjoining  cities  and  has  a 
wide  SES  range.    It  services  one  of  the  fastest  growing  minority  and 
Spanish-surname  populatflns  In  the  area.    The  district  had  14  elementary^ 
three  Intermediate  and  three  high  schools  for  a  total  enrollment  of  16^000 
students*    Thlrty^slx  percent  of  the  district  was  Spanish  <:urnained»  yet 
the  majority  of  these  children  spoke  English.    The  district  Is  highly 
transient  due  to  upward  mobility^  not  agricultural  rolgrancy. 

OvervlMi*    This  site  had  previous  Title  VII  funding  and  had  other  bl^ 
lingual  education  programs  operating  at  both  the  elementary  and  secondary 
levels*    The  school  district  had  nevertheless  been  cited  the  year  before 
by  OCR  as  being  out-of-compllance*    The  PIP  project  served  the  group  of 
students  with  the  second  greatest  need;  the  first  group  was  served  by  a 
different  Title  VII  project.    The  second  year>  the  project  received  a 
smaller  budget  due  to  a  low  LES/nES  count. 

Decision  aakets.    Site  C  was  a  sophisticated  district  with  a  definite 
chain  of  command*    The  superintendent  was  Anglo  and  spoke  no  Spanish  but 
was  supportive  of  bilingual  education.    The  school  board  was  also  suppor- 
tive of  bilingual  education  and  had  one  Chlcano  among  the  five  board  mem^ 
bers.    The  district  had  received  federal  and  state  monies  for  elenientary 
and  secondary  bilingual  programs  for  eight  years. 

The  director  of  one  of  the  districts'  bilingual  programs  attended 
a  county  meeting  and  was  contacted  Informally  by  the  TRC  and  Informed 
of  the  PIPs.    The  director  Invited  the  TRC  to  make  a  presentation  to  the 
district.    Target  principals  attended  the  presentation^  were  shown  the 
ASK»  and  were  loaned  the  PIP  manuals.    An  outside  consultant  was  hired 
to  write  the  proposal.    The  project  ran  smoothly  throtighout  the  different 
phases  as  far  as  the  decision  makers'  activities  and  policies  were  con^ 
cerned . 
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Project  director*    The  project  director  (PD)  had  been  an  elementary 
clasBroom  teacher  In  the  district  bilingual  progrAm  for  two  years  before 
applying  for  the  PD  position*    The  position  was  advertised  statewide,  and 
she  competed  agslnat  many  candidates*    She  was  hired  during  the  summer 
for  one  month  to  rewrite  the  proposal  because  OBE  requested  thst  a  revised 
version  conforming  more  to  the  PIP  model  be  submitted*    (The  Initial  pro*- 
posal  Included  a  system  of  satellite  schools*}    She  was  hired  as  PD  st 
the  end  of  the  summer*    She  Interviewed  snd  hired  sll  the  teecher*aldes 
(TAs)  but  was  not  Involved  In  the  hiring  of  teachers  (Ts)  as  the  prlncl-^ 
pals  weire  very  autonomous  in  this  district  and  hired  their  own  staffs* 
She  had  all  the  PlP-spedf led  qualifications  and  was  an  effective  PD* 

During  normal  oudget  r^egotiations  with  the  Office  of  Education  funds 
were  reduced;  as  a  result,  the  PD  and  the  Instructional  coordinator  (IC) 
roles  were  merged  into  one  position* 

Project  support  staff*    Due  to  a  reductxon  in  the  proposed  budget  the 
first  year,  the  PD  and  IC  positions  were  combined*    The  person  filling  this 
PD-IC  position  was  very  capable  and  performed  adequately*    The  second  year, 
the  PD  assumed  another  position  in  the  district  and  split  her  time  between 
the  new  position  and  serving  as  project  PD*    Hovever,  she  continued  to  be 
sn  effective  PD*    A  full-time  IC  was  hired  the  second  year  and  focused 
primarily  on  staff  development,  which  included  demonstration  lessons  and 
individualized  Inservices*    She  was  an  effective  IC  having  been  Involved 
with  bilingual  education  for  ten  years*    The  person  serving  as  a  community 
coordinator  (CC)  both  years  was  an  experienced  CC  having  occupied  a  similar 
position  previously  in  a  different  bilingual  education  project  in  the  dis- 
trict*   The  evaluator  was  hired  on  a  consultant  basis*    During  the  first 
year,  the  project  contracted  with  the  county  Office  of  Education  for  eval*^ 
nation  services*    The  second  year,  the  project  contracted  with  the  PD  of 
a  bilingual  education  project  in  another  district  to  do  the  evaluation* 
Both  evaluators  performed  their  tasks  adequately* 

Project  Instructional  staff*    One  of  the  three  target  schools  already 
had  two  experienced  bilingual  Ts  at  grades  K  and  1;  the  second  school 
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waa  able  to  tranafer  two  bilingual  Ta;  the  third  achool  had  a  bilingual 
T  in  the  upper  gradea  whom  they  tranaferred  to  the  priiaary  level*  The 
second  year  several  new  Ta  aaked  to  teach  in  the  program*    One  of  the 
project  Ta  waa  working  on  a  bilingual  apecialiat  credential*    Each  T  had 
a  half-time  TA*    All  of  the  TAa  were  bilingual/bicultural  and  were  ade- 
quately qualified  for  their  roles*    They  attf±nded  the  pre-aervice  work- 
shop*    (The  original  propoaal  had  indicated  full-time  TAa*    However,  QBE 
would  not  approve  TAa  at  more  than  a  half-time  level  aince  that  waa  what 
the  Nuevoa  Horizontes  developer  aite  had  had*)    All  staff  were  adequately 
qualified  for  their  roles*    During  the  pre^-service  workshop  the  PD  ex- 
plained the  Nuevos  Horizontea  project  and  gave  each  T  a  copy  of  the 
Teacher^s  Manual-    However,  moat  Ta  read  it  at  the  beginning  and  did  not 
refer  to  it  much  after  that*    During  the  aecond  year  the  loajority  of  Ta 
had  adequat',  language  skilla  for  bilingual  inatruction* 

Other  peraonnel  (regular  atafft  community,  parenta) *    Other  peraona 
played  very  minor  roles*    Some  N/LES  parents  were  not  eager  to  have  their 
children  participate  in  the  project,  fearing  that  their  children  would 
not  learn  Engliah  or  not  learn  it  quickly*    The  project  Ta  and  aite  prin- 
cipala  viaited  or  called  these  parents  to  enliat  their  support*    By  the 
end  of  the  achool  year  parents  were  quite  supportive  of  the  project  and 
aome  volunteered  time  in  project  dasarooma* 

Other  resources  (materiala/equipment^  facilities ,  funds) *    The  PD 
aelected  and  ordered  some  of  the  PIP- recommended  materiala*    She  did  not 
order  all  of  the  recommended  materiala  because  aome  of  them  were  not  appro- 
priate, since  they  were  written  for  Puerto  Rican  children.    Othera,  she 
felt,  were  inferior  to  materiala  that  ahe  knew*    The  three  target  schools 
were  fairly  new  and  all  had  comfortable,  adequately-equipped  clasarooms* 
The  funda  were  adequate  for  both  years  of  project  implementation* 

Plans  and  conatraints*  The  entire  district  used  the  achool  board- 
adopted  reading,  language  and  mathematica  curriculum,  which  was  transi- 
tional in  nature*    Therefore,  the  PIP  performance  objectivea  were  used 
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only  in  science  and  social  studies  since  there  were  no  board^adopted  cur- 
ricula in  those  two  areas*    The  project  staff  did  wish  to  replicate  the 
PIP  project  where  possible* 

Students*  Since  the  district  already  had  a  Title  Vll-funded  bilin- 
gual program  in  K*l»  the  students  being  served  in  this  project »  although 
they  were  also  N/LES»    were  the  group  with  the  second  greatest  need* 

Instructional  treatment*    The  district  had  board-mandated  continuums 
for  scope  and  sequence  in  reading*  language  arts»  and  math  that  guided 
instruction  in  English*    The  project  translated  these  continuums  into 
Spanish  and  thus  the  English  and  Spanish  instructional  strands  were  kept 
parallel*    All  tcdhers  spoke  English  and  Spanish;  however*  there  was  a 
wide  range  in  fluency  and  teaching  experience*    All  aides  were  bilingual 
and  were  used  to  reinforce  lessons  presented  by  the  teacher  and  to  give 
tutorial  help  to  individuals  when  needed*    Children  were  grouped  in  read^ 
ing  and  language  arts  by  language  proficiency  and  achievement  level*  In 
grade  two  children*  for  the  most  part»  were  grouped  by  achievement  level 
in  math  regardless  of  their  language  proficiency*    Instruction  was  provided 
in  the  students'  native  language  for  concept  development  and  the  second 
language  was  used  to  reinforce*    This  followed  the  basic  PIP  suggestions* 
The  instruction  was  adequate*    The  first  year»  the  site  had  six  classes 
in  three  target  schools*    Three  more  classes  were  added  the  second  year; 
there  were  three  kindergarten*  three  first**grade  and  three  second-grade 
classes* 

Reading  and  lanf^uage  arts  were  considered  as  separate  subjects  at 
this  project  site*    In  grade  one»  children  learned  to  read  in  their  dorni" 
nant  language*    In  grade  two»  FES  children  continued  to  read  in  English 
and  received  instruction  in  oral  Spanish  language  and  Spanish  phonics* 
Bilingual  children  read  in  both  Spanish  and  English* 

Children  were  grouped  for  reading  and  read  with  the  T  and  TA*  Chil- 
dren who  read  in  both  languages  received  30  mimites  instruction  daily  in 
reading  per  language;  PES  children  read  in  English  for  40  minutes  daily* 
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Language  arts  for  FES  children  occured  dally  In  English  for  20  minutes 
and  In  Spanish  for  15-20  minutes*    LES/WES  children  received  30  minutes 
dally  Instuctlon  In  English  language  arts  and  15-20  minutes  dally  In  Span- 
ish language  arts*    Math  Instruction  In  English  for  FES  children  was  40 
minutes  dally  and  LES/NES  children  received  math  Instruction  in  English 
for  20-25  minutes  dally  and  math  Instruction  In  Spanlch  for  25-30  minutes 
dally*    Children  Identified  as  being  eligible  for  Title  I  services  went 
to  pull-out  reading  and  math  labs  dally  for  30  minutes* 
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NUGVOS  HORIZOHTGS  ^  SITE  D 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Settlna.    Site  D  is  located  In  a  small,  eeml-lnduetrlal  college  com- 
munity near  a  major  metropolitan  area.    Sixty-five  percent  of  the  student 
enrollment  was  Chicano;  this  enrollment  reflects  the  numerical  majority 
of  Chicano  residents  at  this  site,  most  of  whom  were  employed  in  unskilled 
labor.    Thirty- leven  percent  of  the  district's  Chicano  students  came  from 
households  in  Which  Spanish  was  the  dominant  language. 

Overview.    This  site  had  a  history  of  successful  bilingual  education 
at  the  K  level  for  the  ten  years  preceding  this  project.    District  support 
was  strong  and  the  staff  was  highly  prepared  and  effective.    During  the 
first  year,  all  K  students  in  the  district  were  housed  at  cme  school. 
The  following  year,  all  K  and  1st  grade  classrooms  were  located  in  a  new 
facility.    During  the  summer  preceding  the  second  year,  an  elementary 
school  was  converted  to  house  all  K  and  first  grade  students  in  the  dis** 
trict.    The  school  was  organized  as  an  open  Bchool  with  the  exception 
of  a  few  first  grade  self-contained  classes  that  were  not  funded  by  Title 
VII.    The  K  program  was  excellent  and  had  been  a  demonstration  program 
for  the  state  for  four  years.    Since  it  was  the  principal  and  resource 
teacher  of  this  program  who  desired  the  Title  VII  funds,  this  site  imple- 
mented the  program  only  at  the  K  level  the  first  year  and  expanded  to 
the  first  grade  during  the  second  year. 

Decision  makers.    The  role  of  the  district  decision  makers  (DMs)  at 
this  site  was  unique.    The  superintendent  was  supportive  of  bilingual  edu- 
cation but  played  no  role  in  gatting  a  PIP  project  nor  in  its  implementa- 
tion.   The  key  DMs  were  the  site  principal  and  the  resource  teacher.  Who 
was  slated  to  be  the  project  director  (PD).    This  district  had  a  bilingual 
program  with  different  degrees  of  intensity  for  the  past  ten  years.  The 
principal  and  prospective  PD  decided  to  apply  for  Title  VII  funds  to  im- 
plement a  program  at  kindergarten  level  once  again.    With  the  superinten- 
dent's permission,  they  hired  a  consultant  from  an  outside  firm  to  write 
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the  Title  VII  proposal*    The  consultant  informed  the  site  of  the  PlPa  and 
suggested  they  submit  a  proposal  for  a  PIP  project*    Both  the  principal 
and  the  resource  teacher  supplied  the  consultant  with  all  the  information 
needed  to  write  the  proposal*    The  DMs  wanted  to  implement  the  Nuevos 
Horizontea  PIP  project »  yet  the  Office  of  Education  tried  unsuccessfully 
to  persuade  them  to  accept  the  Venceremos  PIP  project  instead*    As  a  re- 
sult|  the  site  did  not  receive  the  Nuevos  Horizontes  PIP  until  Sept^ber* 

Project  director*    The  role  of  PD  was  successfully  shared  by  the 
principal  and  PD*    Tha  PD  (who  also  acted  as  the  instructional  coordina- 
tor during  the  first  year)  and  the  principal  were  seen  as  having  parallel 
authority  by  the  rest  of  the  project  staff*    The  PD  was  bilingual/bicul- 
tural  and  had  several  years'  bilingual  education  experience  as  both  teacher 
and  resource  teacher  in  the  district*    She  had  all  the  PIP-specif led  qual- 
ifications and  was  an  excellent  PD*    The  principal  was  Anglo  and  spoke  some 
Spanish*    The  staff  had  great  respect  and  loyalty  toward  both  the  principal 
and  PD|  and  it  is  hard  to  imagine  this  kind  of  a  unique  program  elsewhere* 
The  principal  and  PD  tried  to  replicate  the  PIP  project,  but  their  own 
program  v*as  substantially  better  than  the  program  described  by  the  Nuc.os 
Horizontea  PIP*    All  project  staff  at  the  K  school  felt  responsible  for  the 
success  of  the  project  whether  they  worked  directly  with  project  students 
or  not*    During  the  second  year,  a  full*tlme  instructional  coordinator  (IC) 
was  hired  and  the  PD  devoted  all  her  time  to  project  management  duties* 

Project  sup_port  staff*  The  project  had  a  very  strong,  capable  sup- 
port staff  and  this  added  much  to  the  total  success*  The  IC,  who  was 
hired  the  second  year,  had  taught  in  the  bilingual  K  program  for  several 
years  and  had  management  responsibilities  in  the  program*  The  full-time 
coBjDunity  coordinator  (CC)  had  previously  worked  as  an  aide  community 
liaison,  and  migrant  coordinator*  Evaluation  was  contracted  to  an  eval- 
uation firm  skilled  in  evaluation  of  bilingual  education  programs* 

Pro;|ect  instructional  staff*  The  project  teachers  (Ts)  were  all  bi- 
lingual/bicultural,  and  experienced*  All  teacher-aides  (TAs)  were  bilin- 
gual/blcultural ,  and  had  experience  in  bilingual  education  classrooma* 
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It  would  be  difficult  to  find  a  more  experienced >  better  o':alified»  more 
dedicated)  enthusiastic  ^taff.    Since  the  K  school  had  so  many  Is  before 
the  project  was  i]nplemented>  it  was  easy  for  the  principal  and  PD  to  decide 
who  would  bet:ome  the  project  Is*    The  Is  were  willing  to  be  c^asignated  as 
Title  VII  Ts»  yet  it  really  Toade  no  difference  in  thair  duties  and  activi- 
ties»  since  the  K  unit  had  been  operating  a  bilingual  program  before  Title 
VII  fundings    While  the  PD  used  the  PIP  as  a  cheCi.,.^^t»  Ts  were  not  parties 
ularly  aware  they  were  implementing  a  PIP  project. 

The  situation  among  the  project  ins  true  tionail  staff  was  quite  a  bit 
different  the  second  year*    This  was  due  to  the  fact  that  the  aXl*-K  school 
had  moved  to  a  new  facility>  which  tt  shared  with  all  of  the  district's 
first  grade  classes*    Mbst  first  grade  Ta  had  taught  bilingjally  before* 
Some  had  been  iiwolved  in  the  Title  VII  program  years  ago*    Some  had  taught 
bilingual  classes  the  previous  year  under  state  funds*    Some  first  grade 
teachers*  ^o  were  not  accustomed  to  bilingual  instruction*  open-classrooms » 
etc..  re£fisted  the  bilingual  education  progrA!i  and  open  class  management 
style  and  were  allowed  to  remain  in  self-contained  classes*    A  few  of  the 
very  experienced  bilingusl  education  K  Ts  were  moved  into  the  first  grade 
component*    They  we^'e  replaced  in  K  by  adequately  prepared  K  bilingual 
teachers* 

Other  personnel  (regular  stai^f.  community^  parents)  ^    In  this  site, 
it  is  difficult  to  separste  regular  ^nd  project  staff*    The  entire  K-school 
snd  Title  VII  first  grade  section  functioned  tis  a  body  and  was  operated 
as  a  modular  syi^tem;  children  spent  20  minutes  with  each       several  Ts 
throughout  the  day*    All  of  the  staff  was  responsible  for  the  program's 
success,  attended  the  same  pre-  and  i^^  ^jervice  sessions  and  cooperated 
fully* 

The  community  had  both  an  Anglo  and  a  Chicano  groups    Although  Chi^ 
canos  were  in  tae  numerical  majority,  the  schools  and  the  city  were  run 
by  Anglos*    There  wei'e  no  apparent  problems,  yet  there  was  little  contact 
and  interaction  amon^f  these  two  groups*    The  principal  and  PD  made  a  major 
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effort  to  inform  the  community  and  to  include  parents  in  the  children's 
activities.    For  example^  parents  were  invited  to  come  to  school  when 
a  child  first  learned  to  read  so  t:hat  the  child  could  read  for  his  parents. 
There  was  an  English  language  tape-recording  accessible  by  phone  so  that 
one  could  hear  the  K**school  and  1st  grade  activities  for  tha  week.  The 
parent  advisory  committee  meetings  were  lively  and  well  attended. 

Other  resources  (materials/egjipment >  facilities t  funds).    Since  the 
kindergarten  had  been  operating  a  bilingual  education  project  for  so  msny 
years »  they  h&d  loany  K  materisls  already  available.    The  K  facilities  con- 
sisted of  two  Dortable  building^j  and  one  entire  school  building.  During 
the  second  year»  the  entire  district  K  program  moved  across  town  to  occupy 
an  elementary  school  jointly  with  all  the  district's  first  grade  classes. 
This  building  had  previously  been  a  K-6  school. 

Ftinds^  although  sdequate  for  the  first  year»  were  not  received  until 
November;  this  resulted  in  late  orders  for  materials.    The  site  ordered 
a  copy  of  all  of  the  PIP**recommended  materials  and  used  them  as  supple- 
mentsry  materials.    Funds  were  adequate  and  there  were  no  problems  with 
the  budget  the  second  year. 

Plsns  and  constraints.    This  site  selected  the  Nuevos  Horizontes  PIP 
to  replicate  but  the  Office  of  Education  insisted  they  adopt  Venceremos. 
They  negotiated  throughout  the  summer  and  finally  retained  Nuevos  Hori** 
zDntes.    As  a  result^  funding  was  delayed  and  they  did  not  see  the  PIP 
manuals  until  the  fall.    In  fact»  this  really  did  not  create  many  problems 
because  the  PIP  manuals  offered  little  in  the  way  of  u^ieful  infonuaticjn 
for  this  site;  they  really  did  not  need  the  PIP  material  to  install  an 
effectiv«i  bilingual  education  project. 

Students.    In  the  first  year>  the  project  served  approximately  300 
students;  approximately  one**third  of  those  students  were  identified  as 
monolingual  Spanish'-speakers.    During  the  second  year»  fewer  Spanish  mono- 
linguals  were  .     .^w^fied  in  K  but  the  project  was  unable  to  identify  the 
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reason  for  this  decline.    An  estimated  120  students  in  K  and  160  students 
:n  first  grade  were  served  by  the  project  during  the  second  year.  Less 
than  one*third  of  the  project  students  were  identified  as  LES/NES  in  K. 
In  first  grade,  an  esi^imated  56  students  were  identified  as  LES  and  7 
were  identified  NES. 

Instructional  treatment.    The  Title  VII  project  only  encompassed  K 
and  first  grade.    All  K  and  first  graders  in  the  district  attended  one 
school^  which  was  organized  around  three  major  pods  and  a  few  self^ 
contained  classrooms.    Children  in  the  K  program  cpent  a  full  day  in 
school  instead  of  the  usual  half^day.    All  Title  VII  students  were  dis^ 
tributed  throughout  the  two  pods.    Teachers  and  students  did  not  switch 
pods,  but  new  groups  of  teachers  and  children  within  pods  formed  every 
20  minutes  at  learning  centers  throughout  the  day  as  they  moved  through 
the  various  academic  subjects.    All  eleven  project  teachers  in  the  pods 
were  highly  competent,  experienced  teachers.    All  teachers  and  aides 
instructing  bilingual  or  l^i  children  were  bilingual-bicultural.  The 
teachers  who  taught  English  reading  and  English  language  arts  to  mono- 
lingual English-speakers  were  competent,  experienced  Anglo  teachers  who 
spoke  little  or  no  Spanish.    However,  they  never  taug^ht  bilingual  or  LEP 
children* 

Teachers  presented  all  new  material  ^nd  focused  on  concept  develop- 
ment while  aides  did  reinforcing  activities  and  tutored  individual  stu- 
dents when  necessary.    All  instruction  took  place  in  very  small  groups 
at  learning  centers  and  was  individualized  to  the  extent  possible.  Chil- 
dren were  grouped  for  each  subject  by  language  proficiency  and  achieve^ 
ment.    Children's  questions  and  comments  were  accepted  by  the  staff  in 
either  language.    Instruction  was  in  the  student's    native  language, 
complemented  by  ESL  or  SSL  classes. 

Reading  and  language  arts  were  not  regarded  as  distinct  subjects. 
The  language  arts  period  in  the  dominant  language  included  reading,  spell- 
ing and  writing  and  lasted  one  hour  and  fifty  minutes  every  morning.  Math 
instruction  in  the  dominant  language  lasted  thirty^^five  minutes.  Children 
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also  received  ESL,  SSL,  language  enrichment  in  the  dominant  language,  or 
reinforcement  in  English  reading  for  thirty-five  minutes  in  the  afternoon* 
All  subjects  were  taught  using  performance  objectives,  which  were  a  combi*- 
nation  of  previous  site-developed  objectives  plus  P IP-introduced  objectives* 
All  subjects  had  a  continuum  of  skills,  evaluation  materials  and  specific, 
keyed  materials* 
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NUEVOS  HORIZONTES  -  SITES  E,  P,  G 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

The  original  study  plan  for  the  evaluation  of  the  PIP  dissemination 
field  test  was  based  on  four  sites  for  each  PIP*    When  seven  sites  were 
actually  funded  to  implement  Kuevos  Horizontes»  it  was  decided  to  include 
all  seven  in  the  st:udy»  but  to  select  only  four  for  in-depth  analysis  of 
data*    The  remaining  three  were  to  be  visited  on  a  slightly  reduced  sched- 
ule with  a  corresponding  reduction  in  the  level  of  data  analysis*  The 
selection  was  made  after  the  first  two  rounds  of  site  visits*  Selection 
criteria  included  program  size»  and  extent  of  Implementation*    Sites  E»  F» 
and  0^  the  less  intensively  studied  sites»  are  described  here* 

Although  two  sites »  F  and  G»  were  located  in  or  near  large  metropoli- 
tan ar&as»  they  differed  greatly  in  size*    Site  F  had  only  two  classes  the 
'first  year  and  three  classes  the  second  year*    Site  G  had  16  classes  the 
first  year  and  20  the  second  year*    The  third  site»  site  E  was  rural  and 
had  only  two  classes  the  first  year  and  three  classes  the  second  year* 
However  this  site  had  a  concentration  of  Spanish-sur named  population*  which 
ranged  from  10-15%  of  the  approximately  2>500  total  area  population*  The 
variances  were  due  to  the  seasonal  needs  for  agricultural  labor  in  the 
area*    In  general »  this  site  was  a  low^income  area*    Site  F  was  located  in 
one  of  the  most  densely  populated  regiona  in  the  U*S*    It  had  identified 
approximately  1»000  m/LES  students  in  the  district  during  the  first  year* 
Site  G  had  a  large  percentage  of  Spanish-speaking  students*    It  also  had 
a  history  of  high  attrition^  high  mobJlity»  and  low^achievement  scores* 

Two  sites »  F  and  G»  did  have  bilingual/bicultural  teachers  and  aides 
for  both  years*    Site  E  had  one  teacher  who  was  bicultural  but  spoke  al*** 
moE^t  no  Spanish  the  first  year  while  the  other  teacher  was  Anglo  and  spoke 
no  Spanish*    Their  aides  were  bilingual/bicultural*    The  second  year  the> 
were  able  to  hire  a  bilingual  T  who  had  taught  in  another  bilingual  pro- 
gram* 
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Site  E  was  very  cooperative  and  the  project  director  was  dedicated 
and  hard'^orklng  but  lacked  project  management  skills.    The  first  year* 
he  spent  alot  of  time  gaining  the  cooperation  of  the  principal  and  super*- 
Intendent*  who  resented  the  program*  and  spent  very  little  time  In  the 
two  project  classrooms.    As  a  result*  very  little  bilingual  Instruction 
occurred.    Teachers  had  adequate  Instructional  materials  but  did  not  know 
how  to  use  them.    By  the  second  year»  the  PD  gained  very  strong  support 
from  the  Superintendent  and  was  able  to  hire  a  well  qualified*  second 
grade  bilingual  T.    Bilingual  Instruction  occurred  In  this  classroom*  but 
K  and  1st  continued  to  have  less  bilingual  Instruction. 

In  site  F  there  was  a  great  deal  of  difficulty  between  the  PD  and 
principal.    While  the  PD  had  some  knowledge  and  experience*  the  principal 
Was  In  total  control  and  did  not  allow  the  PD  any  declslon*makln^  role. 
They  had  a  bilingual  education  progrsm  but  this  vas  because  of  the  prln- 
clpal's  desire  that  the  program  succeed  since  It  was  In  her  school-*-not 
because  she  believed  In  or  favored  bilingual  education.    The  PD  resigned 
after  the  first  year  and  the  principal  assumed  all  the  duties  of  the  PD 
the  second  year . 

Program  Implementation  In  Site  G  was  affected  by  a  number  of  prob- 
lems.    The  RMC  site  visitors  received  the  Impression  thftt  Nuevos  Horl- 
zontes  was  viewed  locally  as  an  extension  of  existing  bilingual  activities 
rather  than  as  a  distinct*  unique  project.    The  PD's  position  of  half-time 
PIP-project  director  and  half-time  district  bilingual  coordinator  rein-* 
forced  this  perception.    The  PIP  project  Involved  16  classes  In  fojr  tar" 
get  schools  during  the  first  year*  and  20  classes  during  th^  second  year* 
more  than  most  of  the  field-test  PIP  sites  with  full-time  PDs.    Given  this 
heavy  load*  the  PD*  who  was  not  a  highly  skilled  taaiiager*  spent  little 
time  in  the  classrooms.    Other  complicating  factors  included  personnel 
changes  in  the  district  administration*  and  ^arly  lack  of  support  by  some 
principals^    Both  of  these  problems  Increased  the  difficulty  o^  obtaining 
teacher  release  time  and  thus  affected  the  cohesiveness  of  the  project  and 
the  implementation  of  project  features.    Strong  resistance  to  the  project 
from  some  parts  of  the  community  and  school  board  also  presented  early 
problems  for  the  project. 
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By  the  end  of  the  second  year,  most  of  the  major  problems  seecned  to 
be  reduced  or  eliminated.    The  instructional  coordinator,  who  appeared  to 
be  effective,  was  promoted  to  PD  for  the  third  year  of  the  project.  The 
team-* teaching  arrangement,  in  which  students  spent  at  least  half  (more, 
depending  on  individual  needs)  of  their  time  with  a  teacher  who  spoke 
only  Spanish,  and  the  roiainder  with  a  teacher  who  spoke  only  English^ 
had  potential  as  the  basis  of  a  successful  program. 

Site  E  was  cooperative  to  RHC  throughout  the  two  years  of  the  study. 
However,  program  implementation  was  minimal  and  there  was  little  informa** 
tion  available  to  rhC.    Bilingual  instruction  was  never  observed,  although 
a  lot  of  time  was  spent  observing  in  the  two  project  classes. 

Site  F  provided  little  of  the  information  requested  by  Rl^C.  However, 
bilingual  instruction  was  observed  there. 

It  was  difficult  to  meet  with  the  Site  G  project  director,  although 
the  instructional  coordinator  was  helpful.    There  was  also  difficulty  in 
arranging  classroom  observations,  and  the  formal  observations  for  the 
spring  1979  site  visit  were  not  done. 

Funds  were  adequate  for  all  sites.    RMC  did  not  obtain  any  signifi*- 
cant  information  on  parents  and  community  at  any  of  the  three  project 
sites. 


325 


SAVOIR  -  SITE  A 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Setting*    Site  A  18  located  In  a  small  rural  community  with  a  high 
concentration  of  French-speaking  persons*    The  school  district^  also  re- 
ferred to  as  a  parish,  was  comprised  of  twelve  K-4  elementary  schools, 
two  junior  high  schools  and  eleven  K-12  schools  within  a  wide  geographic 
area*    The  district  served  about  9,000  students,  about  thirty  percent  of 
whom  were  from  minority  groups,  lenostly  Black*    ApPro:clmately  seventy-two 
percent  of  the  school  population  were  eligible  for  free  lunch  assistance* 
Over  flfty-cwo  percent  of  the  population  In  the  parish  were  designated 
LES* 

Overview^    The  district  administrative  and  instructional  staffs  at 
this  site  were  generally  enthusiastic  about  bilingual  education*  Prior 
to  Implementation  of  the  PIPs,  the  State-funded  Council  for  the  Develop- 
ment of  French  in  Louisiana  (COOOFIL)  project  had  been  in  existence  for 
the  previous  five  years*    it  was  a  K-5,  second-language  oriented  project, 
designed  to  foster  the  revival  of  the  French  language  snd  culture  in  the 
state*    The  district  had  extensive  contacts  with  a  nearby  bilingual  proj- 
ect*   During  the  second  year,  the  CODOFIL  project  was  reinstated  in  every 
participating  school,  thus  accomodating  the  many  students  who  were  avail- 
able for  participation  but  cou?.d  not  be  admitted  into  the  bilingual  proj- 
ect* 

Decision  makers*    In  deciding  to  apply  for  *  PIP  project.  Site  A  was 
responding  to  the  general  community  and  state-wide  interest  in  reviving 
the  French  culture*    Although  decision  makers  (OHs)  were  genuinely  inter^ 
ested  in  obtaining  useful  ideas  for  effective  bilingual  projects,  they 
were  also  influenced  to  some  extent  by  the  belief  that  their  chances  for 
funding  would  be  improved  if  they  adopted  a  PIP  project*    The  director 
of  federal  programs  (OFP)  initiated  the  preliminary  contacts  with  the 
disseminators  (SEAs  and  TRC  representatives}*    The  OFP  was  the  district- 
level  administrator  who  was  most  involved  and  responsible  for  decisions 
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related  to  Savoir.    He  found  tb    ASK  materials,  the  project  orientation 
loaterials  (POM)  and  the  application  materials  useful*    The  POM  materials, 
in  particular,  were  used  for  presentations  of  the  project  to  parents  and 
principals.    Late  in  August,  the  DFP  received  the  PIP  materials.  All 
along,  he  was  very  actively  involved  and  carried  out        of  the  planning 
tasks.    The  superintendent  was  active  in  building  support  for  the  project. 

Prolect  director.    The  project  director  (PD)  was  identified  early  in 
the  year,  but  not  appointed  until  mid-July.    He  had  experience  as  a  re- 
source teacher  in  the  district.    He  was  bilingual/bicultural  and  had  un- 
derstanding of  and  appreciation  for  the  Acadian  and  Cajun  heritage.  He 
ensured  that  participants  were  involved  in  decision-making  processes. 
The  PD,  French  specialist  and  English  curriculum  coordinator  worked  very 
closely  together.    The  PD  had  an  excellent  relationship  with  decision 
makers  in  the  district.    He  attended  conventions,  training  sessions  and 
workshops  and,  all  along,  seemed  to  have  sufficient  administrative  skills 
for  inplementing  the  project.    His  initiative  was  illustrated  in  integrat- 
ing the  foreign  associate  teachers  in  the  project  and  in  the  schools.  On 
the  whole,  he  did  a  good  job  both  years. 

Project  support  staff.    The  English  curriculum  coordinator  (ECC)  and 
the  French  specialist  (FS)  had  appropriate  skills.    The  ECC  was  recognized 
as  a  master  teacher  in  the  district*    He  visited  classrooms  regularly, 
kept  the  focus  of  his  observations  on  the  students'  acquisition  of  the 
objectives  of  the  English  program,  and  acted  as  a  resource  for  the  project 
Ts.    The  FS  coordinated  in-service  training  relevant  to  the  implementation 
of  the  program  in  French  throughout  both  years.    She  frequently  visited 
classrooms,  arranged  for  workshops  or  courses  in  the  area  of  staff  devel- 
opment, and  aj so  led  the  sessions  and  solicited  feedback  on  them.  The 
evaluation  was  contracted  outside  the  district. 

Prolect  instructional  staff.    In  Site  \,  few  French-speaking  teachers 
(Ts)  and  teacher-aides  (TAs)  were  available.    Most  of  the  project  Ts  and 
TAs  were  not  functionally  bilingual  and  had  no  skills  in  bilingual  educa- 
tion.   Within  the  classroom  setting,  Ts  and  TAs  teamed  up  with  the  foreign 
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associate  Ts  (certificated  in  Europe)  and  depended  almost  entirely  on 
them  for  the  teaching  of  the  French  component  of  the  project*    The  foreign 
associates  were  qualified  teachers  recruited  in  France  and  Belgium  by 
CODOFIL  to  teach  French  in  Louisiana  schools  for  one-  or  two-year  terms* 
In  the  PIP  sites»  they  were  responsible  for  most  of  the  French  language 
instruction*    While  the  foreign  associate  program  is  a  unique  solution 
to  providing  skilled »  enthusiastic  teachers  with  native  French  language 
akills,  there  are  practical  difficulties  that  affect€>d  the  PIP  projects* 
The  transition  to  the  very  different  classroom  and  cultural  settings  of 
Louisiana*  with  little  time  for  preparation*  was  difficult  for  many  of  the 
foreign  associates*    Together  with  their  support  status  in  the  classroom 
and  low  pay»  these  factors  affected  morale  and  contributed  to  the  high 
turnover  at  the  end  of  each  year*    During  the  second  year  of  the  project* 
foreign  associate  teacher  turnover  rate  was  high* 

All  project  Ts»  TAs»  and  foreign  associate  Ts  were  committed  to  the 
project)  and»  as  the  first  year  progressed*  did  an  adequate  job  in  the 
classroom*    The  PD  had  f^rranged  for  credit-bearing  college  courses  in 
second  language  teaching  for  the  project  Ts*    The  combination  of  these 
courses  and  the  ongoing  inservice  program  noticeably  increased  their  knowl- 
edge of  bilingual  education  methods  and  materials*    Before  the  start  of 
the  second  year»  the  site  held  a  four-day  workshop  in  August  with  two  days 
set  aside  for  participation  by  consultants  from  the  regional  TRC* 

Other  personnel  (regular  staffs  communitVi  parents)*    Community  in- 
volvement was  a  problem  at  this  site*    For  eight  to  nine  years»  white 
parents  had  been  removing  their  children  from  the  public  schools »  yet 
they  were  gradually  returning*    While  many  parents  were  enthusiastic  about 
enrolling  their  students  in  the  program*  active  involvement  was  still  dif- 
ficult to  obtain*    Additional  efforts  in  this  area  were  planned  for  the 
second  year  of  the  project*    During  the  second  year,  the  willingness  of 
parents  to  participate  actively  in  project  activities  indicated  their 
increased  committment  to  projec.  goals*    As  a  result,  one  of  the  strongest 
components  of  the  project  vaa  in  the  area  of  parent  involvement*  The 
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meetings  of  the  Parent  Advisory  ComiDittee  (PAC)  were  well  attended  ^nd 
ddditiondl  efforts  were  made  to  eneure  that  e^ch  school  hdd  its  own  sepa- 
rate PAC  the  following  year. 

Other  resources  (materials/equipment ,  facilities ,  funds) .    Few  bilin- 
gual materials  appropriate  to  the  setting  were  available  commercially. 
The  site  purchased  the  carriculum  materials  from  a  nearby  bilingual  proj- 
ect and  from  the  developer  site.    There  was  not  as  much  equi^zienc  in  use 
as  the  PIP  specified*  although  the  district  did  have  some  audiovisual 
equipmentr    Project  schools  were  in  reasonably  good  condition.    Most  oldss- 
rooms  were  of  the  traditional^  self-contained  type.    There  were  displays 
in  both  languages  in  the  classrooms.    Project  funds  were  available  ^nd 
adequate  duriiig  both  years  operation  of  the  project;  by  the  middle  of  the 
first  year  ^he  PD  sought  and  receive^!  continuation  funding. 

Bilingual  materials  that  reflect  the  Louisiana  French  culture  were 
available  in  large  numbera  e^rly  in  the  school  year. 

Flans  and  constraints.    In  this  site>  the  CODOPIL  regulations  spe- 
cified the  availability  of  the  foreign  associate  teachers  and  teacher- 
training  services  and  the  new  state  accountability  law  included  minimum 
standards  that  students  had  to  meet  before  advancing  to  the  next  grade. 
Ts  adapted  the  PIP-specif ied  performance  objectives  to  the  state-mandated 
minimum  standards. 

Students.    In  site  A,  the  pool  of  potential  project  students  was 
identified  on  the  basis  of  surveys  of  language  concentration  and  che 
interest  of  principals  in  having  their  schools  served  by  the  project. 
Students  whose  parents  agreed  were  selected  to  participate  in  the  project. 
They  came  from  families  where  the  dominant  language  and  cultural  orienta- 
tion were  still  Cajun.    Although  some  spoke  a  few  words  of  French^  none 
were  fluent  or  exclusive  speakers  of  French.    In  all  schools*  students 
appreciated  the  Acadian  culture »  and  there  were  more  students  available 
for  participation  than  the  project  could  accommodate. 
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Instructional  treatment*    Project  students  were  grouped  for  Instruc- 
tion according  to  academic  need  In  each  subject  area^  not  according  to 
language  dominance*    In  this  site,  the  basic  Instructional  approach  was 
for  the  regular  classroom  T  to  develop  dally  lesson  plans  following  the 
standard  district  curriculum*    Then  the  foreign  associate  T  developed 
lessons  ^n  French  to  complement  or  reinforce  tha  English-language  lessons 
In  all  subject  areas*    The  team-teaching  approach,  characterized  by  a 
Variety  of  teaching  ntethods  and  activities,  provided  a  means  whereby 
students  received  Individualized  and  personalized  Instruction* 

District  policy  stressed  English  reading  and  mathematics  as  core 
subjects;  the  district  had  a  reading  continuum  for  grades  1-5  for  English 
reading.    Project  teachers  (id)  In  grades  1  and  2  were  three-person  teams 
of  iitonollngual  English  (T),  bilingual  Cajun-Englldh  (XA)  and  monolingual 
French-speaking  "foreign  associate"  T*    Is  and  TAs  depended  almost  entirely 
on  the  foreign  associate  Is  for  the  teaching  of  the  French  component  of 
the  project*    Students  were  grouped  for  Instruction  according  to  academic 
need  In  each  sublect  area*    Six  elementary  schools  and  one  K-12  unified 
school  participated  In  the  project*    There  were  seven  kindergarten,  seven 
first-grade^  and  seven  second**grade  classes  In  this  project* 

Reading  and  language  arts  were  not  regarded  as  distinct  subjects  at 
this  project  site*    French  Instruction  was  closely  coordinated  with  the 
English  language  curriculum,  which  was  based  on  district  and  state  guide- 
lines and  on  performance  objectives*    In  this  site,  some  of  the  PIP-^ 
recommended  materials  were  used  along  with  the  curriculum  guides  from  the 
developer  site  and  from  two  nearby  preexisting  bilingual  proj^acts*  How- 
ever the  majority  of  the  materials  actually  employed  were  developed  by 
the  project  Is,  TAs  and  the  foreign  associate  Ts*    This  site  used  a  combi- 
nation of  whole-class  lessons  and  Individual  or  small  group  activities* 

In  grades  1  and  2  Instructional  time  devoted  to  French  approximated 
ninety  minutes  dally  while  the  amount  of  time  allocated  to  English  basal 
reading  Instruction  was  ninety  minutes,  45-*mlnute  lessons  twice  dally* 
In  grade  2,  students  received  dally  reading  Instruction  In  both  French 
and  English  for  the  entire  year* 
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SAVOIR  -  SITE  B 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Secclng.    Sice  B  is  located  in  a  rural  area  near  a  large  city;  this 
region  has  a  high  concentration  o£  French-speaking  persons^    The  school 
district)  also  referred  to  as  a  parish*  is  comprised  o£  eleven  elementary 
schools*  vhich  housed  either  IC-3»  4-6»  or  IC-6  classrooms*  three  Junior 
high  schools*  and  two  high  schools.    The  district  served  about  9»000  stu** 
dents»  slxty-£our  percent  o£  vhom  were  designated  limited  English^^speaking 
(LES)*    Over  eighty  percent  o£  these  LES  students  were  concentrated  in  the 
three  elementary  schools. 

Overview.    Administrative  and  instructional  sta££s  at  this  site  were 
£ully  supportive  o£  bilingual  education.    The  district  had  extensive  con- 
tacts with  a  nearby  bilingual  project.    The  project  encompassed  the  three 
elementary  schools  in  the  district  with  the  highest  concentration  o£  LES 
students. 

Decision  makers.    The  most  relevant  decision-maker  was  an  active  su- 
pervisor o£  £ederal  programs  (SFP)  with  experience  in  bilingual  education 
and  some  expertise  in  dissemination.    Within  the  district*  he  was  a  power- 
£ul  administrator  through  whom  all  £inancial  matters  passed.    The  super- 
intendent's role  was  minimal  but  both  he  and  the  SFP  £elt  the  need  £or  ^ 
bilingual  program.    Factors  in£luencing  their  decision  to  have  a  bilingual 
program  included  the  Lau  decision  and  the  general  community  and  statewide 
interest  in  reviving  the  French  culture.    They  saw  adoption  o£  a  PIP  proj- 
ect as  a  way  o£  securing  Title  VII  £unds.    Various  disseminators  (in  the 
SEA  and  TRC)  in£ormed  the  SFP  about  PIPs,  assisted  him  £irst  with  the  ASK, 
then  later  niade  available  to  him  xeroxed  copies  o£  PIP  manuals.  Continued 
TRC  contacts,  coupled  with  the  help  o£  the  Lau  Center  sta££,  helped  the 
SFP  to  acquire  the  technical  in£onnation  needed  £or  writing  a  proposal. 
The  SFP  was  not  oriented  toward  replication,  but  was  concerned  about  the 
0££ice  o£  Education's  role  in  monitoring  project  implementation.    He  was 
Very  actively  involved  and  carried  out  many  o£  the  planning  tasks  until 
the  project  director  was  hired  late  in  July. 
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Project  director*    The  project  director  (PD)>  a  man  of  Cajun  descent > 
was  previously  employed  as  an  administrator  In  the  district  transportation 
department*    He  had  experience  as  a  classroom  teacher  at  the  junior  high 
level*    He  was  a  llfe-^long  resident  of  the  district*    While  he  did  not 
have  experience  In  bilingual  education »  this  did  not  appear  to  cause  a 
problem*    The  PD  established  a  very  good  relationship  with  the  SFP  and 
with  other  decision  makers*  an<!  planned  to  foster  additional  Involvement 
on  the  part  of  principals  during  the  second  year*    The  PD  attended  the 
three-"day  training  session  conducted  by  a  consulting  flrm»  and  got  exten*- 
slve  help  from  the  TRC  and  SEA  consultants*    Experienced  staff  from  neigh- 
boring districts  also  helped  the  PD  to  a  great  extent*    The  PD's  Initia- 
tive Is  Illustrated  In  the  training  he  provided  and  in  his  Integration  of 
the  12  foreign  associate  teachers  In  the  project  and  the  schools*    At  the 
end  of  the  first  year^  he  spent  a  month  In  Quebec  with  project  teachers 
attending  a  summer  Institute  sponsored  by  the  Council  on  the  Development 
of  French  In  Louisiana  (CODOFIL)*    The  PD,  In  spite  of  his  late  Involve- 
ment with  the  project,  used  the  ASK  m&terlals»    the  slide  tape/cassette» 
and  the  poster  for  pre-servlce  presentations*    He  found  the  calendar  and 
the  time  schedule  very  useful*    He  also  read  the    PIP  Evaluation  Manual 
and  the  Practical  Guide  for  Evaluating  Achievement* 

Project  support  staff*    Support  staff  roles  at  this  site  varied  some- 
what from  the  model  outlined  by  the  Savoir  PIP*    One  person  filled  both 
the  English  curriculum  coordinator  (CC)  and  French  specialist  positions* 
He  was  previously  employed  as  a  college  professor  of  French  literature 
but  had  some  background  In  second  language  development  and  school  curric- 
ulum*   He  was  functionally  blllp'^ual*    He  ordered  the  curriculum  guides 
from  a  nearby  bilingual  project  and  translated  these  Into  English*  He 
also  purchased  the  curriculum  guides  developed  at  the  original  site*  He 
and  the  PD  jointly  developed  materials  reflecting  the  Cajun  language  and 
culture  associated  with  the  school  district*    The  project  contracted  with 
an  outside  evaluator* 

Project  Instructional  staff*    Many  of  the  teachers  (Ts)  and  teacher- 
aides  (tAb)  were  of  Cajun  ancestry  and  their  attitudes  were  generally 
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positive  toward  the  cultural  revival*    However^  the  principsls  were  the 
ones  who  determined  the  level  of  interest  on  the  part  of  the  Ts*  Then, 
based  on  such  an  assessment,  these  Is  were  required  to  participate  in  the 
project.    A  description  of  the  Savoir  project  was  presented  to  these  se- 
lected Is.    Items  used  in  mak^^a  presentations  included  the  ASK,  the  slide/ 
cassette  tape,  which  showed  teiiching  personnel  how  the  project  operated  in 
the  developer  site»  and  the  poster  written  in  both  French  and  English* 

Only  a  small  number  of  projecu  Ts  and  TAs  were  functionally  bilingual* 
T     Ts  did  have  some  knowledge  of  bilingual  education  methods  and  they 
had  the  ability  to  select,  develop  and  use  appropriate  performance  objec- 
tives^ materials  and  activities  to  fit  their  students'  needs*    TAs  were 
barred  by  state  laws  from  having  nny  instructional  duties* 

Within  the  classroom  settings  project  Ts  and  TAs  teamed  up  with  for- 
eign associate  £Sf  (native  French-speaking  Ta  certificated  in  Europe)  snd 
depended  almost  entirely  on  these  foreign  associates  for  the  teaching 
cf  the  French  component*    The  foreign  associates  are  qualified  teachers 
recruited  in  France  and  Belgium  by  COPOFIL  to  teach  French  in  Louisiana 
schools  for  one-  or  two-year  terms*    In  the  pip  sites »  they  were  respon- 
sible for  most  of  the  French  language  instruction*    While  the  foreign  as- 
sociate program  was  a  unique  solution  to  providing  skilled^  enthusiastic 
teachers  with  native  French  language  skills^  there  were  practical  diffi- 
culties that  affected  the  PIP  projects*    The  transition  to  the  very  dif- 
ferent classr  oom  a.'^.d  cultural  settings  o£  Louisiana  was  difficult  for 
many  of  the  foreign  associates  although  they  adopted  quite  well*  Another 
factor  that  contributed  to  the  difficulties  was  a  reluctance  by  the  for- 
eign associates  to  live  in  the  communities  in  which  they  taught*  Although 
they  complained  abo>'t  their  support  status  in  the  clasaroom  and  low  pay» 
all  of  the  first-year  foreign  associates  remained  for  the  second  year* 

Ts  and  TAs,  but  not  the  foreign  associste  teachers^  attended  the 
start-up  workshop*    In  accordance  with  PIF  specif ications>  the  workshop 
covered  a  number  of  broad  areas »  such  as  ti:e  components  of  the  project 
itself »  the  rationale  of  a  program  in  French  ana  ^.ts  cultural  emphasis^ 
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the  performance    bjectives  and  their  use  in  monitoring  and  assessing  stu- 
dent achievement,  and  bilingual  materials  development*    The  foreign  asso- 
ciate tochers  underwent  a  three-day  training  session  organized  by  the  SEA 
and  a  two-day  orientation  meetint  set  up  by  the  dijcrict.    Zkus^  the  spe- 
cific roles  of  the  Ts,  TAs,  foreign  associates,  and  the  support  ^taff  were 
made  clear.    Throughout  the  first  year  of  the  project,  the  PD  arranged  for 
monthly  in-service  training  for  teaching  personnel  (including  the  foreign 
associates)*    The  district  negotiated  with  local  colleges  for  credit- 
bearing  courses*    Good  communication  was  maintained  among  the  project 
instructional  staff  throughout* 

During  the  second  year,  teacher  turnover  was  high  at  one  of  the  par- 
ticipating schools*    This  second  year,  a  major  attempt  was  ciade  to  provide 
the  foreign  associate  teacher  with  local  housing;  the  project  benefited  by 
having  them  agree  to  live  in  the  community*    However,  some  of  them  still 
encountered  problems  in  making  the  transition  to  the  rural  cultural  set- 
tings of  Louisiana* 

Other  personnel  (regular  staff,  community,  parents)*    Community  in- 
volvement had  not  been  a  problem,  except  that  parents  attending  the  Parent 
Advisory  Committee  ^PAC)  meetings  did  not  know  how  to  get  involved  in 
community  activities  to  support  and  extend  the  project*    However,  school 
programs  and  activities  were  well  attended  by  parents  and  community  mem- 
bers*   Additional  efforts  aimed  at  obtaining  more  active  involvement  were 
planned  for  the  second  year  of  the  project* 

Otlr'^r  resources  (materials/equipment^  facilities,  funds)*    The  dis^ 
trict  was  reasonably  wel?  equipped*    There  did  not  seem  to  be  much  hard- 
ware, although  there  was  a  room  full  of  new  System  80s  at  the  district  of- 
fice*   Little,  if  any»  bilingual  material  wa<%  available  until  the  project 
staff  purchased  curriculum  materials  from  a  nearby  site  and  curriculum 
guides  from  the  developer  site*    In  every  classroom,  foreign  associate 
teachers,  project  teachers,  and  Cajun  TAs  c  operatively  prepared  materials 
^nd  planned  French  lessons  that  paralleled  the  English  components*  and 
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other  project  staff  also  substantially  adapted  the  PIP  performance  objec- 
tives to  sulc  the  otate-mandated  and  district  standards*    Appropriate  En- 
glish materials  were  aval!! able  to  classroom  Is,  but  the  French  commercial 
materials  arrived  late  In  the  first  term*    In  this  site,  It  did  not  appear 
that  Is  had  sufficient  training  to  adequately  select  materials*    The  site 
did  develop  curriculum  activities,  Identify  and  adapt  relevant  social  stu*- 
dies  materials,  and  develop  additional  French  materials  for  social  studies 
and  other  curriculum  areas*    This  was  in  keeping  with  what  happened  at  the 
developer  site*    However,  In  the  development  of  test  Instruments,  partlcu-* 
larly  In  French,  this  &lte  clearly  needed  more  help* 

Project  schools  were  In  excellent  condition*    One  new  school  had  a 
modem  open  design  with  four  open  sections  (K*3)  surrounding  an  open  li- 
brary/media center*    Other  schools  were  older  and.  In  those,  the  class- 
rooms were  of  the  traditional,  self-contained  type*    In  some  of  the  self- 
contained  rooms,  the  furniture  vas  arranged  to  form  learning  centers;  In 
others,  the  desks  were  arranged  In  rows.    District  offices  were  adequate, 
though  not  attractive,  being  located  In  an  old  school  with  adjacent  por- 
tables*   The  district  had  a  good  tax  base  and  regular  programs  were  more 
than  adequately  funded*    These  Ts  ^^btq  thz  highest  p^ld  In  the  state* 

Plans  and  constraints*    In  this  site,  factors  other  than  the  PIP 
determined  the  direction  In  which  the  project  developed*    The  CODOFIL 
regulations  specified  the  availability  of  foreign  associate  teachers  and 
of  teacher-training  services,  and  the  new  state  accountability  law  In- 
cluded some  limits  on  the  performance  objectives  used  by  the  project* 

Students*    The  pool  of  potential  project  students  was  Identified  on 
the  basis  of  surveys  of  language  concentration  and  the  Interest  of  princi- 
pals In  having  their  schools  served  by  the  project*    Students  whose  par*- 
ents  agreed  were  selected  to  participate  In  the  project*    However,  the 
students  came  from  families  where  the  dominant  language  and  cultural 
orientation  were  still  Cajun*    Although  some  spoke  a  few  words  of  French, 
none  were  fluent  or  exclusive  speakers  of  French* 
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Instructional  treatment.    District  policy  stresses  English  reading* 
mth^natlcs  and  social  studies  as  core  subjects.  Project  Ts  In  grades  1 
and  2  are  three^person  teams  of  monolingual  English  (T)»  bilingual  Cajun- 
English  (TA)  and  monolingual  French-speaking  "foreign  associate"  T.  The 
7  and  TA  depend  almost  entirely  on  the  foreign  associate  T  for  the  teach- 
ing of  the  French  component  of  the  project*    Students  are  grouped  for  In** 
structlon  according  to  academic  need  In  each  subject  area.    During  the 
second  yea,  ^here  were  nine  kindergarten*  eight  f lrst**grade»  and  eight 
second-grade  classes  In  this  project. 

Project  students  were  grouped  for  Instruction  according  to  academjc 
need  in  each  subject  area»  not  according  to  language  dominance.    It  was 
the  foreign  associate  teachers'  responi»lblllty  to  present  concept  devel-* 
opmettt  activities  in  French*  thus  following  up  on  concept  development  ac-^ 
tivities  in  English  as  carried  cut  by  the  classroom  teacher.    Because  of 
the  European  educational  background  of  the  foreign  associate  teachers* 
the  ?I?**specified  method  of  ordering  instruction  oi.  the  basis  of  perfor*- 
mance  objectives  was  uot  uniformly  applied  across  schools.    A  strict 
separation  between  the  sessions  in  which  English  and  French  were  spoken 
was  easily  maintained^  and  no  switching  back  and  forth  to  facilitate  un-* 
derstandj.ng  waf>  observed  except  in  kindergarten*  where  such  a  prar,tice 
is  called  for  by  the  PIP.    The  amount  of  time  spent  on  French  instruction 
came  close  to  one-third*  as  specified  in  the  PIP.    A  team<-taaching  approach 
was  used  in  the  clatrsroom*  which  provided  students  with  individualized  in- 
struction and  a  variety  of  teaching  methods  am-I  activities.    This  variety 
of  methods*  activities  and  role  models  appeared  to  contribute  to  a  high 
level  o£  student  interest. 

Reading  and  language  arts  arc  not  regarded  as  distinct  subjects  at 
this  project  site.    Frenr,h  instruction  is  closely  coordinated  with  the 
English  language  curriculum  which  is  based  on  district  and  state  guidelines 
and  on  performance  objectives.    In  this  site  r^om^^  of  the  PlP^^recomiiended 
materials  have  been  used  as  have  the  curriculum  guides  from  the  developer 
site  and  from  two  nearby  preexisting  bilingual  projects.    However*  the 
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majority  of  the  materials  actually  employed  have  been  developed  by  the 
project  Tb,  TAb»  and  the  foreign  associate  Is*    This  site  used  a  combina- 
tion cf  vhole-'class  instruction  and  indiviaual  or  small-group  activities* 

In  gi*ades  1  and  2,  instructional  time  devoted  to  French  is  approxi- 
mately ninety  minuses  daily*    Th*  amount  of  time  allocated  to  English 
basal  reading  instruction  is  ninety  minutes  daily,  45*Mninute  lessons  twice 
daily*    In  second  grade,  studenti,  receive  daily  reading  instruction  in  both 
French  and  English  throughout  the  entire  year,  although  the  Pip  does  not 
require  the  addition  of  French  reading  until  third  grade* 
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SAVOIR      SITE  C 

PROJECT  SUMKA.KY 
1977-1978  and  1978-1979 

Setting*    Site  C  Is  located  In  a  small>  rural  community  with  large 
concentration  of  French-speaking  persons.    "SY^v.  nchool  district^  also 
referred  to  as  a  parish*  was  comprised  of  eight  elementary  schools  which 
housed  either  K-2»  K-*3»  3-*6»  or  4-*8»  and  seven  high  schools  which  house<J 
7-12»  4-12»  or  9-12.    The  district  served  about  8^758  students^  aDout  41% 
of  whom  were  Black.    Approximately  37%  of  the  population  In  the  district 
were  receiving  food  stamps.    Elghty-Lwo  percent  of  the  students  In  the 
district  were  designated  LES.    Three  elementary  schools  participated  in 
the  project. 

Overview.    The  district  administrative  and  Jnstructlonal  staffs  were 
enthusiastic  about  bilingual  education.    Prior  to  iioplementing  the  PIPs» 
this  site  had  a  Title  Vll-funded  bilingual  project.    Also>  the  state-funded 
Council  for  the  Development  of  French  in  Louisiana  (CODOPIL)  project  was 
in  existence  in  the  district  for  the  previous  five  years.    It  was  a  K-5> 
second-language  oriented  project^  designed  to  foster  the  revival  of  the 
French  language  and  culture  in  the  state.    The  district  had  extensive 
contacts  with  a  nearby  bilingual  project. 

Decision  makers.    The  first  contact  regarding  bilingual  PIPs  at  this 
sltd  was  between  a  Title  VII  project  director  (PD) »  later  to  become  the 
PIP  PD»  and  an  0B£  representative.    The  superintendent  and  the  school 
board  were  supportive  of  bilingual  education.    Besides  viewing  PIPs  as 
a  way  to  obtain  Title  VII  funds »  the  decision  to  apply  was  Influenced 
by  the  general  community  and  state-wide  Interest  in  reviving  the  French 
culture.    The  regional  Training  Resource  Center  (TRC)  and  the  State  Edu- 
cation Agency  (SEA)  staff  Informed  the  PD  further  about  PIPs;  TRC  staff 
assisted  her  in  writing  the  proposal.    She  was  very  actively  Invrlved 
and  Carried  out  most  of  the  planning  tasks  until  she  was  assigned  the 
position  of  Savolr  PD  in  the  middle  of  July  1977, 
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Project  director*    The  PD  was  of  Cajun  descent*     In  addition  to  her 
PIP  duties,  she  maintained  her  previous  Title  VII  position*  \^lch  had 
given  her  bilingual  managerient  experience*    She  had  a  strong  background 
In  bilingual  education,  having  worked  as  a  French  bilingual  specialist 
at  the  elementary  and  secondary  level*    She  had  an  excellent  relationship 
with  the  superintendent  and  thus  was  In  a  position  appropriate  for  direct*- 
Ing  the  projects    She  was  a  very  effective  PD  and  generated  a  climate  of 
enthusiasm  for  the  PIP  project,  both  among  the  project  and  regular  teachers* 

Project  support  staff*    The  English  curriculum  coordinator  and  the 
French  specialist  were  committed  to  the  project  and  to  bilingual  education* 
Their  language  skills  were  sufficient  to  fulfill  their  roles  In  the  proj- 
ect*   Both  were  doing  a  good  Job  and  fulfilling  their  respective  roles  In 
the  project*    The  evaluator  was  a  private  consultant  with  experience  In 
bilingual  project  evaluation*    He  was  based  at  a  nearby  university*  He 
pt^rformed  his  Job  efficiently  and  was  available  to  the  PD  for  consulta- 
tions * 

Project  Instructional  staff*    Very  few  project  teachers  (Ts)  and 
teacher-aides  (TAs)  were  functionally  bilingual  or  had  skills  In  bilingual 
education*    Within  the  classroom  setting,  project  Ts  and  TAs  teamed  up 
with  the  foreign  associate  teachers,  certificated  In  Europe,  and  depended 
almost  entirely  upon  them  for  the  teaching  of  the  French  component  of  the 
project*    The  foreign  associates  were  qualified  teachers  recruited  in 
France  ^nd  Belgium  by  CODOFIL  to  teach  French  In  Louisiana  schools  for 
one-  or  two-year  terms*    In  the  pip  sites,  they  were  responsible  for  most 
of  the  French  language  Instruction*    While  the  foreign  associate  program 
1&  a  unique  solution  to  providing  skilled,  enthusiastic  teachers  with  na- 
tive French  language  skills,  there  are  practical  difficulties  that  affected 
the  PIP  projects*    The  transition  to  the  veiy  different  classroom  and  cul- 
tural settings  of  Louisiana,  with  little  time  for  preparation*  was  diffi- 
cult; for  many  of  the  foreign  associated*    Together  with  their  support 
8tatu5i  In  the  classroom  and  low  p^y,  these  factors  affected  morale  and 
contributed  to  the  high  turnover  at  the  end  of  each  year* 
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All  project  Ts,  TAs,  and  foreign  associate  Ts  were  committed  to  the 
project  and  were  effective  Ts.    The  project  Ts''  prior  experience,  current 
college  training,  and  ongoing  in-service  program,  were  the  major  influences 
on  their  instructional  roles.    The  foreign  associate  teachers'"  prior  Euro- 
pean educational  background  and  the  district  ongoing  in-service  program 
were  the  major  Influences  on  their  instructional  roles.    The  TAs  were 
barred  by  state  law  from  having  instructional  duties.    Th^  FIF  h^d  no  dis^ 
cerniblfe  impact  on  instruction  at  this  site.    During  the  second  year, 
foreign  associate  T  turnover  -^ate  was  high. 

Other  personnel  (regular  staffs  community^  parents).    Community  in-- 
volvement  wa<?  a  problem.    For  eight  to  nina  years,  many  white  parents^ 
including  those  of  French  descent,  had  removed  their  children  from  the 
public  schools,  but  they  were  gradually  returning.    Whixe  many  parents 
were  aithusiastic  about  enrolling  their  students  in  the  program,  active 
Involvement  was  still  difficult  to  obtain. 

During  the  second  year,  the  willingness  of  parents  to  participate 
actively  in  project  activities  indicated  their  increased  ccmmittment  to 
project  goals.    Each  school  had  ^  Farent  Advisory  Committee  (FAC);  the 
meetings  were  well  attended.    Some  parents  assisted  Ts  and  TAs  in  class- 
room activities,  and  niany  participated  in  other  project  events  that  sup- 
ported and  extended  the  project. 

Other  resources  (materials/equipment ,  facilities,  funds^.    Pew  bilin- 
gual materials  were  commercially  available  to  the  project  for  this  setting. 
The  site  purchased  the  curriculum  materials  f^om  a  nearby  bilingual  project 
and  from  the  developer  site.    Most  of  the  English  instructional  materials 
used  in  project  classrooms  were  already  in  use  in  the  district.    The  French 
specialist  developed  new  French  curriculum  materials  baf^ed  on  the  currlcu** 
lum  guides  purchased  from  a  nearby  bilingual  project.    Also,  \\e  substan- 
tially adapted  the  PIF  performance  objectives  to  suit  the  state-mand'^ted 
and  district  standards.    There  was  not  as  much  equipment  in  use  as  tltt  PIP 
specified,  although  the  district  had  some  audiovisual  equ^p'ncnt*  Tlie 
project  classrooms  were  large  and  quite  aceqiiatc  Tor  project  instruction* 
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In  fiome  of  the  claddrooms  the  furniture  was  arranged  to  form  learning  cen- 
ters; in  others  the  desks  were  in  rows.    The  PD's,  curriculum  coordinator's 
and  French  specialist's  offices  were  located  in  a  modern  building  that 
housed  most  of  the  district's  special  projects*    The  available  space  was 
adequate.    Project  funds  were  available  and  sdequate  during  the  first  year 
of  operation;  by  mid-year  the  pp  was  seeking  continuation  funding  and 
prospects  for  continued  support  for  the  second  year  looked  good. 

Plans  and  constraints.    In  this  site,  the  regulations  of  the  CODOFIL 
specified  the  availability  of  the  foreign  associate  teachers  -  aacher- 
training  services.    The  new  state  accountability  law  indudea      iie  limits  on 
objectives,  in  that  there  were  minimum  standards  diat  students  had  to  reach 
before  advancing  to  the  next  grade.    Ts  adapted  the  PIP-specif ied  perfor- 
mance objectives  to  the  state<^mandated  minimum  standards. 

Students.    In  tnis  site,  the  pool  of  potential  project  students  was 
identified  on  the  basis  cf  surveys  of  language  concentration  and  the  in- 
terest of  principals  in  having  their  schools  served  by  the  project.  Stu- 
dents whose  parents  consented  were  selected  to  participate  in  the  project. 
Participating  students  spoke  a  few  words  of  French,  but  none  were  fluent 
or  exclusive  speakers  of  French. 

Instructional  treatment.    District  policy  stresses  English  reading 
and  mathematics  as  corci  subjects.    Project  Ts  in  grades  1  and  2  were  three** 
person  teams  of  monolingual  English  (T)^  bilingual  CaJun^^English  (TA) , 
and  monolir>.gual  French-speaking  "foreign  associate"  T.    T  and  TA  depended 
almost  entirely  cn  the  foreign  associate  T  for  the  teaching  of  the  French 
component  of  the  project.    Students  were  grouped  for  instruction  according 
to  academic  need  in  each  subject  area,  not  according  to  languag.^  dominance. 
It  was  the  foreign  associate  teachers'  responsibility  to  present  concept 
development  activities  in  French,  thus  following  up  on  concept  development 
activities  In  English  as  carried  out  by  the  classroom  teacher.    Because  of 
the  Ei'xopean  educational  background  of  the  foreign  associate  teachers »  the 
PIP-apccif led  method  of  orderl:'\g  instruction  on  the  basis  of  performance 
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objectives  was  not  uniformly  applied  across  schools.    A  strict  separation 
between  the  sessions  in  which  English  and  French  were  spoken  was  easily 
maintained »  and  no  switching  back  and  forth  to  facilitate  understanding 
was  observed  except  in  kindergarten^  vhere  such  a  practice  was  called  for 
by  the  PIP.    In  Site  C  the  aToount  of  time  spent  on  French  was  much  less 
than  what  was  specified  in  the  PIP.    A  team-- teaching  approach  was  used  in 
the  classroom^  which  provided  students  with  Individualized  instruction  and 
a  variety  of  teaching  methods  and  activities.    There  were  eight  kindergar- 
ten>  eight  first-grade^  and  eight  second-grade  classes  in  this  project. 

Reading  and  language  arts  were  not  regarded  as  distinct  subjects  at 
this  project  site.    French  instruction  was  closely  coordinated  with  the 
English  language  curriculum  which  was  based  on  district  guidelines  and 
performance  objectives.    In  this  site  some  of  the  PlP-reconmiended  materi- 
als were  used»  as  had  the  curriculum  guides  from  the  developer  site  and 
from  two  nearby  preexisting  bilingual  projects.    However  the  majority 
of  the  materials  actually  employed  had  been  developed  by  the  T>  the  TA> 
and  the  foreign  associate  T.    This  site  up?d  a  combination  of  whole  class 
lessons  and  individual  or  small  group  activities. 

In  grades  1  and  2  instructional  time  devoted  to  French  approximated 
sixty  minutes  daily>  while  the  amount  of  time  allocated  to  English  basal 
reading  instruction  was  ninety  minutes  daily  (two>  45-mlnute  daily  ses- 
^  sions).    In  grade  2»  students  received  daily  reading  instruction  in  English 
from  October  through  mid-year>  then  reading  instruction  in  both  French  and 
English  for  the  entire  year. 
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SAVOIR  -  SITE  D 

PROJECT  SUMMARY 
1977^1978  and  1978-1979 

Setting*    Site  D  is  located  in  a  small  rural  community  with  a  high 
concentration  of  persons  whose  native  language  is  French.    The  three 
participating  school  districts  consisted  of  three  elementary  schools^ 
two  of  which  housed  K-8»  while  the  other  one  housed  grades  K-6.    Two  high 
schools  served  these  three  elementary  districts.    The  districts  served 
about  1^640  students.    Fifty  percent  of  the  school  population  was  eligible 
for  free  lunch  assistance.    Between  fifty  to  sixty  percent  of  the  project 
children  were  designated  LES. 

Overview.    District  support  for  bilingual  education  was  strong.  The 
district  had  previously  implemented  a  Teacher  Corps  project »  which  had  a 
positive  impact  on  the  development  of  bilingual  education  in  the  state. 

Decision  maker.    The  most  relevant  decision  maker  was  an  assistant 
superintendent  who  was  informed  about  the  PIPs  by  a  professor  at  a  nearby 
university.    The  superintendent's  role  was  minimal^  but  both  he  and  the 
assistant  superintendent  felt  the  need  for  a  bilingual  program.  Motivation 
to  apply  for  a  PIP  project  was  influenced  to  some  extent  by  the  belief  that 
their  chances  for  fundin^  would  be  improved  if  they  adopted  a  PIP  project^ 
although  they  were  also  interested  in  obtaining  useful  ideas  for  implement- 
ing an  effective  bilingual  project.    The  aesistant  superintendent  went  to 
a  nearby  university  for  help  in  preparing  a  proposal  for  Title  VII  funds. 
The  university  personnel  had  been  associated  with  the  Teacher  Corps  project^ 
knew  the  TRC  staff  and  were  familiar  with  the  PIPs.    The  assistant  superin-* 
tendent  carried  out  most  of  the  planning  tasks  and  was  involved  until 
a  project  director  was  hired  late  in  August. 

Project  director.    The  project  director  (PB)  came  from  a  bilingual 
home.    She  was  previously  employed  as  a  staff  member  in  a  bilingual  mte-^ 
rials  development  center  in  this  region.    She  was  aware  of  project  goals> 
philosophy  and  features  well  before  she  was  hired »  having  attended  a  P.\P 
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presentation  given  by  a  staff  member  of  the  Office  of  Planning,  Budgeting 
and  Evaluation  the  preceding  year.    She  established  a  very  good  relation- 
ship with  the  decision  mskere  and  quickly  became  aware  of  district  mech-* 
anlsms  and  hierarchy.    She  sought  technical  assistance  from  the  university 
personnel  mentioned  above.    In  spite  of  the  fact  that  she  was  hired  late> 
she  was  able  to  start  the  project  effectively  and  efficiently.    She  hsd  a 
solid  knowledge  of  laws»  policies^  and  guidelines  affecting  the  project. 
Throughout^  she  demonstrated  a  strong  commitment  to  the  project  and  to 
bilingual  education.    At  the  end  of  the  first  year  of  the  project^  she 
spent  six  weeks  In  Dljon^  France^  where  she  attended  various  training 
sessions  snd  workshops. 

During  the  s-icond  year  of  the  project^  the  quality  of  communication 
among  everyone  Involved  remslned  high.    The  PD  did  not  have  sufficient 
time  available  for  staff  observation;  as  a^result  project  teachers  were 
not  visited  on  a  regular  basis.    However*  the  PD  organized  a  comprehensive 
staff  development  program. 

Project  support  staff.    Support  staff  roles  varied  from  the  model 
outlined  in  the  PIP.    Toe  French  specialist*  hired  by  the  PD,  acted  as  a 
demonstration  teacher,  supervisor  of  TAs*  and  resource  teacher  for  the 
development  of  French  curriculum  units.    He  was  working  full-^tlme  and 
resigned  at  the  end  of  the  first  year.    The  English  curriculum  coordlna-* 
tor  was  also  hired  by  the  PD.    She  acted       a  demonstration  T,  and  super- 
visor of  TAs,  and  was  responsible  for  coordinating  the  French  and  English 
Curricula.    She  also  resigned  at  the  end  of  the  first  year  and  the  PD  had 
to  select  replacements  for  both  positions.    Both  had  been  doing  well  In 
their  respective  assignments. 

The  Parent -Community  Coordinator  directed  the  preschool  program  based 
in  the  homes  of  preschoolers  themselves;  she  taught  demonstration  lessons, 
supervised  TAs  and  developed  curriculum  units.    In  the  morning,  an  addi- 
tional bilingual  specialist  acted  as  a  full-time  K  teacher  and  In  the 
afternoon  served  as  a  resource  teacher  and  supervisor  of  TAs  for  Grades  I 
and  2  In  the  third  participating  school. 
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During  the  second  year  support  staff  turnover  rate  was  high  and  the 
PD  allocated  a  considerable  amount  of  time  to  fill  vacancies  and  train 
new  staff  membGrs*    Support  staff  roles  did  not  vary  from  the  model  that 
was  followed  last  year* 

Project  instructional  staff.    In  this  site*  only  a  small  number  of 
participating  classroom  Ts  were  bilingual*    All  of  the  project  TAs  were 
bilingual*    A  fourth  full-time  staff  member*  the  bilingual  specialist* 
acted  as  a  K  teacher*  resource  teacher*  and  supervisor  of  TAs  for  grades 
1  9Xid  2  in  one  of  the  project  schools;  she  was  also  bilingual*    All  proj- 
ect Ts  and  TAs  were  committed  to  the  project*  and  as  the  year  progressed* 
most  of  them  were  doing  an  adequate  job  in  the  classroom*    The  PD  had 
arranged  for  and  was  teaching  credit-bearing  college  courses  in  second- 
language  teaching  for  the  project  Ts»  and  these*  as  well  as  the  successful 
ongoing  in-service  program*  noticeably  increased  Ts'  knowledge  of  bilin- 
gual education  methods  and  materials*    All  of  them  appeared  to  be  enthu- 
siastic and  the  project  appeared  to  be  having  a  positive  impact  on  student 
and  staff  motivation* 

During  the  second  year*  teacher  turnover  rate  was  very  high  and  the 
PD  allocated  a  considerable  amount  of  time  to  fill  vacancies  and  train 
new  teachers* 

Other  personnel  (regular  staff,  community^  parents)*    While  in  two 
of  the  participating  districts*  the  PIP  project  enjoyed  the  full  support 
of  the  community  and  the  parents*  in  one  participating  district  parental 
support  was  a  problem.    Some  parents  in  that  district  did  not  warvt  to  en- 
roll their  students  in  the  program*  since  they  viewed  any  attempt  to  teach 
French  as  increasing  the  barrier  to  education;al  success* 

The  willingness  of  participants  to  become  involved  iu  a  student  ex* 
change  program  with  a  nearby  French-speaking  Canadian  elenentary  school 
indicated  the  degree  of  the  commitment  of  the  community  to  project  goals* 
Such  a  program  represents  a  unique  solution  to  providing  increased  oppor- 
tunities for  crossing  into  a  nearby  French-speaking  Canadian  province* 
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Other  resources  (materlalfl/equlpment,  facllltlest  funds)*    One  major 
influence  at  this  site  was  the  Exemplary  Center  for  Reading  Instruction 
(ECRI)  materials*    This  site  devoted  considerable  effort  into  developing 
French  materials  corresponding  to  the  ECRI  materials*    Some  commercial 
materials  were  also  employed  in  the  program^  and  money  was  allotted  for 
teachers  tr  buy  materials  that  might  be  helpful  in  the  design  of  French 
units  of  instruction*    Most  of  the  P IP-re commended  instructional  materials 
were  already  in  use  at  this  site;  the  remaining  PIP*recommended  materials 
were  subsequently  purchased^  along  with  the  curriculum  guide  from  the 
origination  site>  which  was  not  mentioned  in  the  PIPs*    Project  schools 
were  in  good  condition*    Dlstr?ct  offices  were  somewhat  crowded^  but  ade*- 
quate*    Regular  programs  were  adequately  funded* 

Plans  and  constraints*    In  *^his  3ite>  factors  other  than  the  PIP 
were  more  influential  in  determining  the  direction  that  the  project  took* 
Among  these  factors  were;    the  ECRI  program;  the  newly  passed  state  law 
on  mandatory  competency-based  testings  which  affected  instructional  ob- 
jectives and  the  asses^m3nt  of  student  progress;  and  the  guidance  received 
from  a  nearby  university* 

Students*    The  criterion  for  student  selection  was  that  either  the 
father  or  mother  be  a  French  speaker  or  that  French  be  spoken  in  the  home 
by  other  family  members*    A  majority  of  the  students  who  participated  were 
not  actually  French  speaking*    In  this  site>  French  was  used  primarily  in 
language  arts  and  social  studies*    Thti  aiiftO,u.t  of  time  in  which  French  was 
spoken  to  students  was  much  lower  than  the  one-third  of  the  day  recommended 
in  the  PIP* 

This  site  employed  £CRI»  a  mastery  learning  technique  which  purported 
to  enhance  vocabulary  and  comprehension  skills  through  the  use  of  written 
and  oral  drill*    Individual  and  small  work  groups  were  integral  parts  of 
the  instructional  methodology*    Students  rotated  from  one  station  to 
another  throughout  the  mornings  working  successively  v/ith  the  regular 
classroom  T#  the  French  T#  and  the  French  TA* 
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Inatructlonal  treatment*    District  policy  stresses  English  reading 
and  language  arts  ^  core  subjects;  in  addition  to  oral  skills^  students 
in  grade  1  were  introduced  to  reading  and  writing  French.    There  was  very 
little  emphasis  on  bicultural  curriculum  or  activities.    Project  Ts  in 
grades  1  and  2  were  organized  as  three-person  teams  of  monolingual  English 
T»  TA>  and  bilingual  French- English  teacher.    There  were  five  kindergarten, 
five  first*grade,  and  five  second**grade  classes^  and  three  third^grade 
classes  in  the  second  yer  of  the  project. 

The  methodology  used  for  French  reading  instruction  followed  the  dis- 
trict's practice  for  English  reading  instruction;  it  was  based  on  ECRI,  a 
martery  learning  technique  aimed  at  enhancing  vocabulary  and  comprehension 
skills  through  the  use  of  written  and  oral  drill.    Individualization  and 
small  groups  were  an  integral  part  of  the  instructional  methodology. 

The  ratio  of  French  daily  instruction  to  students  varied  somewhat 
across  schools  and  ranged  anywhere  from  twenty  to  thirty  minutes.  Instruc- 
tional time  devoted  to  English  basal  reading  instruction  was  ninety  minutes 
daily.    At  this  project  site»  first  grade  students  received  English  reading 
and  French  pre-reading  instruction  for  the  entire  year»  while  second  grade 
students  received  reading  instruction  in  both  French  and  English  for  the 
entire  year. 
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TONCEREMOS  -  SITE  A 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Setting*    Site  A  is  a  small »  rural  community  of  4000  persons  of  which 
over  half  are  Chicanos*    Fifty-six  percent  of  the  students  in  the  district 
are  Chi^'ranos*    The  district  consists  of  four  schools:    a  preschool  and  kin* 
dergarttin  school*  a  first  through  fifth  grade  elementary  school*  a  junior 
high  school  throug^h  grade  eight*  and  a  high  school* 

Overviev*    This  site  had  a  Title  Vll-funded  bilingual  project  for  the 
previous  five  years*    District  support  for  bilingual  education  was  strong* 
The  PIP  project  provided  funds  for  continuing  the  district  bilingual  edu* 
cation  program*    In  addition*  the  district  had  a  state-funded  bilingual 
project  in  grades  K-3*    The  projects  operated  smoothly  both  years*  The 
district  as  a  whole  was  essentially  stable  and  personnel*  instructional 
techniques  and  attitudes  were  not  subject  to  ivtajor  change*    The  district 
had  a  strong  emphasis  on  reading  and  language  development  almost  to  the 
exclusion  of  other  subjects*    The  reading  program  rigidly  required  stu-» 
dents  to  progress  at  a  set  pace* 

Decision  makers*    The  superintendent  at  this  site  was  formerly  an  ad- 
ministrator at  the  Venceremos  origination  site*  approximately  twenty^^eight 
miles  away*    This  decision-maker  was  generally  familiar  with  the  PIP  proj- 
ect management  component*    Decision-makers  felt  their  dxances  for  a  second 
five-year  cycle  would  be  enhanced  by  participating  in  a  field  study  of  PIPs* 
yet  the  district  was  not  really  interested  in  replicating  a  Pip  project* 
Decision-makers  were  favorably  disposed  toward  bilingual  education  and  were 
supportive  of  the  project*    The  district's  curriculum  coordinator*  a  Chi- 
cana*  was  the  former  Title  VII  project  director  snd  was  strongly  supportive 
of  the  project*    The  level  of  district  commitment  to  bilingual  education 
generally  and  to  the  existing  bilingual  project  specifically  was  strongs 

Project  director*    The  role  of  project  director  was  already  established 
in  the  district  from  the  Title  VII  project  over  the  preceding  five  years* 
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The  project  director  was  a  Chlcana  and  formerly  a  bilingual  teacher  for  the 
district's  previous  Title  VII  project.    While  she  had  no  training  or  ex- 
perience in  project  management,  she  had  functioned  as  a  project-director 
substitute  on  a  f^  occasions  when  the  project  director  was  auay.    The  PD 
was  connected  to  a  regional  bilingual  resource  and  support  network  and 
used  that  network  as  a  source  of  information  i^out  bilingual  education; 
this  participation  was  an  indicator  of  a  strong  commitment  to  bilingual 
education.    Overall,  she  was  an  effective  project  director. 

The  project  director's  management  style  and  function  were  not  influ*- 
enced  by  the  PIP*-specif ied  function  in  any  significant  way. 

Project  support  staff.    The  project  support  staff  included  a  commu*- 
nity  liaison  (CL)  and  an  outside  evaluator/staf f  development  consultant 
(BV/SDC).    A  PIP-specified  instructional  coordinator  (IC)  was  not  hired 
by  the  district  because  it  didn't  want  to  have  to  absorb  another  middle- 
management  position  when  the  Title  VII  funds  terminated.    The  CL  poaition, 
while  not  PIP-apecif ied,  was  a  para-professional  position  that  existed  in 
the  previous  Title  VII  project  ani  was  merely  carried  over.    The  same  per- 
son continued  in  that  role.    This  person  was  a  very  competent  Chicana  and 
coordinated  the  project's  parent  education  activities,  mobiliz.ed  parent 
volunteers  and  produced  a  regular  project  n^sletter.    She  performed  her 
job  very  well  both  years. 

The  EV/SDC  was  affiliated  with  a  large  private  contractor  who  wrote 
thia  site's  Title  VII-PIP  proposal  with  the  expectation  that,  if  funded, 
they  would  receive  the  contract  to  conduct  the  project's  staff  develop- 
ment and  evaluation.    The  BV/SDC  was  assisted  by  several  persons  from  the 
same  company;  all  were  very  competent,  efficient  and  esti^lished  good  rap** 
port  with  the  project  staff.    During  the  second  year,  the  EV/SDC  concen- 
trated on  training  the  project  staff  in  inatructional**delivery  techniques 
and  borrowed  extensively  from  Montessori  techniques  for  tnath  instruction. 

The  staff  configuration  and  roles  of  the  project's  support  staff  were 
not  influenced  in  any  major  way  by  the  PIP  specifications  and  guidelines. 
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Project  Instructional  staff.    Three  of  the  four  project  teachers 
(Is)  and  all  the  teacher-aides  (TAs)  were  Chlcanas  and  formerly  In  the 
district's  previous  Title  VII  project.    They  were  all  very  competent,  ex- 
perienced and  committed  bilingual  teachers;  they  did  their  job  very  well. 

For  the  most  part,  these  Ts  did  not  regard  the  PIP  favorably  and  did 
not  use  It.    During  the  first  year,  they  resented  the  weekend  and  after^ 
school  In-servlce  sessions,  and,  particularly,  the  development  of  perfor** 
manee  objectives.    However,  by  spring,  this  negative  attitude  had  subsided. 
The  Instructional  role  o£  TAs  was  already  established  In  the  district,  as 
were  all  other  project  roles.    The  project  TAs  performed  their  job  well. 
Several  of  the  project  Ts  were  attending  a  nearby  tmlverslty  and  working 
on  master's  degrees  In  bilingual  education. 

During  the  second  year,  one  of  the  two  K  Ts  took  a  maternity  leave. 
This  T  was  an  English  monolingual  T  who  team  taught  with  a  bilingual  T. 
The  T  on  leave  was  replaced  by  another  English  monolingual  T.    As  planned, 
the  project  expanded  Into  the  second  grade  during  the  second  year.  The 
project  T  and  TA  assigned  to  thlc  grade  were  trained  and  ex:)erlenced 
bilingual  Instructors. 

The  PIP  Influenced  neither  the  staffing  configuration  nor  the  roles 
of  the  project's  Instructional  staff.    However,  the  project  had  funds 
budgeted  for  staff  development  activities  and  this  resulted  In  required 
In-servlce  sessions.    The  focus  of  this  training  was  not  a  response  to 
teacher  ^-Initiated  concern  as  the  FIP  recommended;  the  hiring  of  the  SDC 
had  a  direct  Impact  on  the  Ts  because  It  created  additional  training  ses- 
sions and  several  work  sessions  devoted  to  felting  performance  objectives. 
To  a  great  extent,  the  PIP  Influence  of  additional  staff  development  actlv* 
Itles  vas  superfluous  for  these  experienced  and  competent  bilingual  In- 
structors* 

Other  personnel  (regular  staff,  communltVi  parents).    The  school 
principal  was  not  well  Informed  about  the  project  and  was  not  an  enthu- 
siastic supporter  of  It  during  the  first  year.    The  project  director 
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avoided  working  through  the  principal  unless  absolutely  necessary*  During 
the  second  year»  the  principal  attended  several  orientation/  training  ses** 
sions  for  district  administrators  conducted  by  the  SEA*    After  these  ses- 
siond»  the  FD  reported  thst  the  principal  was  better  informed  and  more 
cooperative  and  supportive  of  the  program* 

The  district  also  operated  s  state-funded  bilingual  project;  there 
was  frequent  contact  between  the  two  bilingual  projects*    About  half  of 
the  non-PIP  project  teachers  were  Chic£tno»  including  all  the  state  bilin- 
gual project  teachers^    Some  team-teaching  between  PlP^roject  and  regular 
teachers  occurred^    The  allocation  of  a  TA  to  PIP-project  Ts  created  some 
tension  from  the  regular  Ts  who  had  to  shsre  a  few  TAs  among  them*  For 
the  most  part»  the  regular  staff  was  superficially  informed  about  the  pro*** 
ject  and  viwed  it  as  compensatory;  while  they  were  not  enthusiastic  sup* 
porters »  they  were  not  an  obstruction*    By  the  end  of  the  first  year»  some 
regulsr  Ts  acknowledged  that  the  project  was  serving  students  Whom  they 
could  not  serve  adequately  and  acknowledged  that  it  made  their  jobs  easier^ 
The  regular  staff  did  not  influence  the  operation  of  the  project  in  any 
noticeable  way^ 

The  parents  at  the  project  site  had  a  long  history  of  very  active 
involvement  in  school  affairs*    It  was  not  uncommon  to  have  two  hundred 
parents  turn  out  at  meetings*    For  this  reason^  the  district  decided  to 
limit  the  parent  representation  on  advisory  committees  to  one  parent  per 
grade  level*    Parent  volunteers  were  not  permitted  in  the  classroom  by 
district  policy*    A  district-wide  parent  advisory  committee  (PAC)  for  bi- 
lingual education  existed*    This  PAC  reviewed  the  project  proposal  and 
endorsed  it*    The  bilingual  PAC  met  regularly  and  members  were  elected 
by  parents »  not  appointed  by  the  district*    A  lot  of  communication  flowed 
both  to  and  from  the  PAC  to  the  district*    During  both  yesrs^  the  project 
conducted  parent  education  workshops  that  were  well  sttended* 

Other  resources  (materials/equiPmentt  fscilities^  funds)*    This  proj- 
ect had  an  abundance  of  bilingual  materials  available  due  to  its  prior 
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Title  VII  project  and  the  distrlct-wlde,  state-supported  bilingual  proj- 
ect*   In  addition  ^o  classroom  materials,  the  project  director's  office 
was  well  stocked  with  3  wide  assortnteni;  of  resource  and  reference  materl-* 
als  In  both  languages*    Some  of  the  project  classrooms  were  large  and 
well  equipped;  however,  the  district's  kindergarten  classes  (all  In  the 
project),  located  at  an  old,  run-down  school — the  old  Chlcano  elementary 
school**-were  cold  and  reeked  of  gas  fumes  In  the  winter*    The  project 
director's  office  was  almost  as  large  as  the  principal's;  the  project  had 
a  second  classroom-slze  office  shared  by  the  project  secretary  and  the  CL* 
In  addition,  the  project  had  a  teacher's  resource/work  room  that  was  used 
by  project  Ts,  parents  and  the  CL  for  preparing  materials*    Hone  of  the 
Instructional  materials  or  facilities  used  In  the  project  were  PIP- 
Influenced*    Xhe  majority  were  already  In  ude  prior  to  this  project's 
existence* 

Project  funds  were  allocated  In  late-suomier  of  the  first  year;  this 
delay  meant  some  last  minute  T  assignments  and  created  a  lot  of  pressure 
on  the  project's  start**up  and  Initial  operations  stages  due  to  late  prep- 
aration of  lessons  and  curriculum  materials*    However,  the  staff's  prior 
blIlTigual**project  experience  eased  the  pressure  considerably*    In  the  fall 
of  1977,  the  Office  of  Bilingual  Education  augmented  the  project's  budget 
by  providing  additional  unsolicited  funds  for  evaluation,  staff  develop- 
ment, travel  and  equli»Ekent*    This  appropriation  was  Intended  to  allow  the 
site  to  conform  with  jplp  specifications  for  the  field  test*    Xhe  project 
purchased  a  photocopy  machine  with  some  of  these  funds*    Since  the  school 
previously  had  to  use  the  high  school's  copier,  the  project  had  a  valuable 
and  much  needed  resource  which  they  willingly  shared  with  non-project 
personnel*  This  created  considerable  goodwill  by  non-project  Ts  who  made 
use  of  the  copier* 

Plans  and  constraints*    The  state  education  codes  as  well  as  state 
and  federal  bilingual  education  rules  and  regulations  were  the  project's 
jfuldlng  force*    The  district  had  no  Office  of  Civil  Rights  problems*  The 
project  derived  its  direction  from  the  district's  prior  experience  In  bl^ 
lingual  education*    PIP  recommendations  and  guidelines  had  no  noticeable 
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Impact  on  the  project*    There  were  no  0£  sanctions  for  failing  to  repli- 
cate the  PIP  project* 

Students  fSs>*    The  project  served  grades  K-l  the  first  year*  First 
grade  Ss  had  been  in  the  previous  Title  VII  bilingual  project  and  merely 
continued  on  to  this  project's  first*grade  bilingual  classes*    The  proj- 
ect expanded  to  include  grade  two  during  the  second  year*    These  Ss  had 
two  years  of  prior  instruction  in  a  Title  VII  bilingual  program*  Teachers 
snd  the  project  director  reported  that  although  the  Ss  had  some»  albeit 
liniitedt  English  profic^encyt  they  scored  low  on  an  English-language  pro- 
ficiency test*    They  al4o  reported  a  comparable  limited  proficiency  in 
Spanish  language  among  the  project  Ss* 

Instructional  treatment*    The  instruction  received  by  the  project 
Ss  continued  to  be  guided  by  the  district's  experience  in  bilingual  edu- 
cation* The  PIP  instructional  component  was  vague  and  generalized*  thus 
the  PIP  Impact  on  classroom  instruction  was  negligible*    For  this  reason* 
and  because  of  pressure  from  aome  school  persoTmel»  all  project  students 
received  reading  instruction  in  Spanish  and  English  concurrently* 

District  policy  at  this  site  requires  that  a  student  progress  through 
a  specified  number  of  books  in  the  bassl  reading  program*    Students  who 
have  not  completed  all  of  the  readera  required  at  that  grade  level  for 
the  acadanic  year  are  retained*  irrespective  of  how  close  to  completion 
they  are*    The  project  has  abundant  current,  commercially*avallable  bilin* 
gual  instructional  materials  and  a  well-stocked  workroom  for  preparation 
of  locally-developed  instructional  materials*    Project  Ts  in  grades  I  and 
2  were  trained  and  experienced  biligual  Ts,  with  appropriate  fluency  in 
both  Spanish  and  Englitsh*    The  Ts  conduct  all  instruction  and  used  TAs 
to  reinforce  it*    There  were  two  first-grade  and  two  second-grade  class*' 
rooms  in  this  project* 

Reading  and  language  arts  are  regarded  as  distinct  subjects  at  this 
project  site*  The  majority  of  the  students  get  their  instruction  in  En^ 
glish,  although  a  few  students  get  forty  minutes  of  Spanish  reading  two 
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or  three  tiroes  a  week;  this  time  block  is  shared  with  cultural  and  cre- 
ative arte  instruction  and  these  subjects  are  alternately  taught  during 
the  week  but  without  a  r^ular  alternation  schedule.    In  one  of  the  two 
second'^grade  classrooma»  students  get  forty-five  minutes  of  Spanish  read- 
ing instruction  daily.    Instruction  in  reading*  language  arts  and  math  is 
done  in  small  groups;  listening  and  activity  centers  are  commonly  used 
for  most  lessons. 

The  instructional  schedules  for  grade  1  were  identical.  Students 
received  sixty  minutes  of  English  reading  instruction  in  groups  and  an 
additional  thirty  minutes  of  supplemental  reading  on  a  daily  basis,  they 
received  thirty  minutes  of  math  instruction  and  thirty  minutes  of  language 
arts  .Instruction  daily.    As  already  noted,  project  students  in  grade  1 
also  recevied  forty  minutes  of  Spsnish-reading  instruction  several  times 
a  week.    The  instructional  schedules  and  amount  of  time  devoted  to  in- 
struction varied  to  an  extent  in  grade  2.    Each  of  the  two  classrooms  daily 
had  sixty  minutes  of  reading  instruction  in  groups  and  thirty  minutes  of 
spelling  and  also  thirty  minutes  of  math  instruction.    Students  in  one 
classroom  got  forty-five  minutes  of  Spanish-reading  instruction  daily, 
thirty  minutes  of  English  oral  language  three  times  a  week  and  handwrit- 
ing the  remaining  two  days  each  week.    The  other  second-grade  classroom 
devoted  thirty  minutes  daily  to  English  oral  language  instruction. 
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VEMCBREMOS  -  SITE  B 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Setting*    Site  B  is  a  small »  semiTursl  town  with  a  population  of 
approximately  18»000»  of  which  thirty  percent  are  Chicanos.    Over  half 
of  the  elementary  school  children  in  this  district  are  Chicano»  and  the 
percentage  is  steadily  increasing.    The  school  district  was  comprised  of 
three  elementary  schools »  one  junior  high  and  one  high  school. 

Overview.    This  site  had  a  stste-funded  bilingual  education  project 
for  the  two  years  prior  to  Title  VII  funding.    The  diistrict  was  under  a 
federal  court  order  in  a  school  desegregation  suit  that  remained  unre* 
solved  after  a  decade.    In  response  to  an  Office  of  Civil  Rights  (OCR) 
desegregation  suit»  the  district  adopted  a  cluster-^school  approach  to 
school  integration  whereby  district  schools  were  designated  to  serve  Bpe* 
cified  grade  levels.    Thus»  one  school  served  all  the  students  In  grades 
iC*l  in  the  district)  and  so  forth.    The  level  of  commitment  to  bilingual 
education  in  this  district  was  minimal  find  guarded.    The  majority  of  the 
project  teachers  were  not  bilingusl  nor  trained  as  bilingual  teachers. 
The  project  director  and  the  Instructional  coordinator  swapped  positions 
at  the  end  of  the  first  year.    This  staff  change  did  not  disturb  the 
continuity  of  the  project  to  any  appreciable  extent. 

Decision  makers.    The  dliitrict  decision*makers  were  fundamentally 
conservative  and  resistant  to  change.    They  were  proud  that  they  never 
left  the  basics.    During  the  first  year»  the  superintendent  stated  that 
he  was  willing  to  try  a  Title  VII  project  for  one  year  to  see  if  it  would 
produce  results.    Although  the  district  was  skeptical  about  bilingual 
education*  they  felt  that  the  PIP  project^  ^ased  on  an  exemplary  program* 
was  worth  a  try.    This  attitude  slso  prevailed  during  the  second  year  of 
the  project. 
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Prolect  Qlrector.    The  project  director  during  the  first  year  wss 
a  Chicana  with  over  twenty-one  years  tenure  with  the  district;  she  was 
formerly  a  bilingual  teacher  and  coordinated  the  state-funded  bilingual 
project  in  the  district.    This  latter  assignment  provided  her  no  release 
time  and  actually  made  few  time  and  administrative  demands.    With  this 
minor  exception,  the  project  director  had  no  prior  training  or  experi- 
ence in  project  management.    Although  she  did  an  adequate  job,  the  non* 
supportive  climate  and  lack  of  sufficient  bilingual  teachers  made  the 
project  director  feel  inadequately  trained  to  handle  the  role.    By  year'a 
end,  the  project  director  had  decided  to  resign  this  position  and  assume 
the  role  of  instructional  coordinator  for  the  project,  a  position  for 
which  she  was  ainnly  qualified  and  experienced.    The  PD  for  the  second  year 
had  considerable  administrative  experience;  her  prior  staff  development 
role  in  the  project  permitted  her  to  introduce  instructional  strategies 
as  well. 


Project  support  staff.    During  the  first  year,  the  project  support 
staff  included  a  half-time,  instructional  consultant  (IC)  and  an  outside 
evaluator/staff  development  consultant  (eV/SDC)*    The  IC  had  prior  admin- 
istrative experience  and  was  working  on  a  doctorate  in  education  admin- 
istration at  a  major  state  university.  She  was  very  competent  and  sup- 
portive of  the  project;  this  helped  bolster  the  project  director.  Her 
primary  functions  were  to  observe  instruction,  assist  in  the  writing  of 
perf oimiance  objectives,  and  assist  in  conducting  parent  workshops;  her 
role  also  included  conducting  staff  training  sessions*    The  EV/SDC  at 
this  site  was  the  same  person  contracted  at  Venceremos  Site  A.    He  was 
affiliated  with  the  contractor  who  wrote  the  site's  Title  VII  proposal 
with  the  expectation  of  receiving  the  contract  for  the  project's  evalua- 
tion and  staff  development  components,  if  funded.    This  EV/SDC  was  as- 
sisted by  several  persons  employed  by  the  contractor,  all  of  whom  were 
very  competent,  including  the  EV/SDC.    The  project  director,  however, 
felt  that  these  persons  were  not  sufficiently  available  and  were  provid- 
ing very  few  direct  services  to  the  project.    The  primary  function  of 
the  EV/SDC  was  project  evaluation;  the  IC  conducted  most  of  the  staff 
development  activities  during  the  year. 
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During  the  second  yesr^  the  first^yesr  pD  sssumed  the  IC  role  88  8 
full-time  position.    She  continued  the  88me  £unction8  performed  by  the 
£ir8t^ye8r  IC  yet  extended  the  cl888room  ob8erv8tion8  of  in8truction  and 
provided  8  con8ider8ble  amount  of  direct  as8istaace  to  project  T8»  p8rtic*- 
ul8rly  the  8econd  gr8de  18.    In  addition^  the  IC  866isted  in  the  a88es6^ 
ment  of  the  8ppropri8te  l8ngu8ge  8nd  level  for  re8ding  instruction  to 
determine  placement  of  8ll  new  children.    The  project  contracted  with  8 
different  BV  the  aecond  year;  the  PD  had  a  greater  role  in  apecifying  the 
nature  of  the  evaluation  aervicea  that  the  EV  provided.    The  PD  had  a 
prior  acquaintance  with  thia  EV^  which  helped  to  enaure  a  positive  and 
effective  reiationahip  between  them.    The  BV  waa  very  competent  and  re*- 
aponaive;  he  waa  baaed  at  a  major  univeraity  about  an  hour  away  from  the 
project  site. 

Project  inatructionsl  staff.    During  the  firat  year>  three  of  the 
twelve  K~l  project  teachers  (Ts)  were  Chicanaa.    Three  project  Ta  were 
experienced  bilingual  Ta»  of  which  two  were  trained  aa  bilingual  teachera. 
The  reat  of  the  project  Ta  were  monolingual^  yet  three  had  completed  a 
lOO-hour  language  courae  offered  by  the  SEA  to  obtain  a  bilingual  endorse-* 
ment*    With  one  exception^  the  project  Ts  were  competent  and  experienced^ 
although  not  aa  bilingual  Ta*    All  project  Ta  were  already  working  in  the 
diatrict.    The  majority  o£  these  Ts  were  recruited  into  the  project  by 
the  school  principal  with  the  assurance  that  they  would  aerve  for  only 
one  year^  at  which  time  they  would  be  relieved  by  other  regular  teachers. 
About  half  of  the  project  Ta  were  supportive  of  the  project.    At  year's 
end»  five  of  the  aix  K  and  three  firat  grade  Ta  left  the  project. 

Each  project  T  waa  aaslgned  a  teacher»alde  (TA).    All  of  the  TAs  were 
Chicane  and  bilingual;  moat  of  them  were  committed  to  the  project.  One 
of  the  twelve  project  TAs^  a  Chicane  male»  waa  very  committed  and  politi** 
cally  atrong;  he  waa  very  supportive  of  die  project  director.    In  grade  1» 
three  of  the  six  Ta  were  bilingual;  teaming  theae  bilingual  and  monolingual 
Ts  eaaed  the  problem  somewhat.    The  T  and  TA  rolea  were  not  influenced  by 
the  FIF;  they  were  defined  by  prior  practicea  in  the  project  aite.  Refiis* 
tance  by  project  Ta  to  writing  performance  objectives  was  so  atrong  that 


the  PD  chose  to  do  it  for  the  Ts  in  a  committee  comptised  of  herself »  the 
district  curriculum  coordinator  and  the  part-time  IC.    K  Is  were  not  satis** 
fied  with  the  draft  of  the  objectives  and  bpcaiae  involved  in  rewriting 
them  and  coordinating  them  with  district  objectives* 

'  During  the  second  year  as  the  project  expanded  to  the  second  grade, 
two  of  the  five  second  grad^^  Is  were  experienced  and  trained  bilingual 
Is.    These  two  Is  had  previously  taught  in  the  district's  state-funded 
bilingual  program*  Of  these  five  Ts,  only  one  had  state  bilingual  certif- 
ication; bilingual  certification  was  pending  for  two  of  the  remaining 
four  Is* 

Other  personnel  (regular  staff,  community,  parents)*  The  K-1  school 
principal  was  alternately  supportive  and  resistive  on  some  issues*  By 
the  end  of  the  first  year,  although  he  was  not  committed  to  the  project, 
he  was  generally  more  neutral  and  mildly  supportive  of  the  project  direc* 
tor*  The  other  school  principal  for  the  second  and  third  grade  school  was 
generally  more  supportive  of  the  project*  For  the  most  part,  the  regular 
staff  was  only  superficially  informed  about  the  project  and  although  gen- 
erally friendly,  they  were  skeptical  about  its  value* 

A  parent  advisory  committee  (PAC)  for  the  project  was  formed  and  oper- 
ated, yet  its  function  was  largely  procedural*     There  wasn't  any  evidence 
of  broad**based  community  or  parent  support  for  the  project  the  first  year* 
However,  by  the  end  of  the  second  year,  there  was  a  noticeable  improvement 
in  parent  participation  on  the  PAC* 

Other  resources  (materials/equipment,  facilities*  funds)*    The  major- 
ity of  the  instructional  materials  used  in  the  project  were  already  in  use 
in  the  district*    Additional  materials  wete  purchased  with  Title  VII  funds 
in  the  latter  part  of  the  first  year*    The  Spanish-language  materials  in 
use  were  influenced  largely  by  the  SEA's  service  center  which  provided 
technical  assistance  and  staff  training  to  state  and  federal  bil  igual 
projects  In  the  area*    The  equipment  used  in  the  project  wae  cl  ^ady  in 
use  in  the  district  * 
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During  the  first  year»  the  project  director  and  project  secretary 
(PS)  initially  shared  a  small  offict^  that  nad  no  telephone  and  could  only 
be  entered  through  the  school  library  or  the  principal's  office*    By  mid- 
year) a  project  telephone  vas  installed  and  the  ps  moved  into  the  adjacent 
library,  creating  a  project  outer  office.    At  the  beginning  of  the  second 
year,  the  project  office  vas  moved  to  a  district  building  that  also  housed 
the  diatrict  curriculum  coordinator's  office  and  a  variety  of  county  so- 
cial service  programs*    This  building  vas  located  directly  across  the 
atreet  from  the  main  district  administration  building*    These  project  of» 
fices  vere  large^  veil  lit,  and  provide  adequate  space  for  the  PP,  IC, 
and  PS*    The  project  vas  altuatf;d  at  tvo  of  the  three  district  elementary 
achools*    Project  classrooms  were  veil  equipped  and  adequate  for  project 
instruction* 

Project  funds  were  available  in  mid-July  during  the  first  year* 
This  allowed  sufficient  time  for  start»up  activities* 

Plans  and  constraints*    This  site  had  a  desegregation  court  order 
dating  back  ten  years;  in  December,  1977,  OCR  cited  the  district  because 
it  vas  found  to  be  out  of  compliance  vith  the  Lau  remedies* 

State  educational  code  and  district  policy  guided  the  project  imple- 
mentation*   Local  policies  prevented  the  hiring  of  appropriate  project 
teachers  at  the  time  these  teachers  vere  available*    The  majority  of  the 
project  Ts  vere  English  !Bonolinguals  *    PIP  guidelines  influenced  the 
project's  staff  configuration*    They  also  influenced  the  conduct  of  pre- 
service  and  in-service  vorkshops*    During  the  first  year,  the  project 
director  used  the  PIP  project  management  directory  to  gauge  her  perform 
mance,  but  not  to  define  her  role  since  in  numerous  cases  the  pip  mflte* 
rial  did  not  provide  sufficient  information* 

Studenta*    The  project  served  gradea  K-l  the  first  year*    Firat  grade 
atudents  (Ss)  had  been  served  by  the  state  funded  bilingual  program  the 
previous  year*    The  project  expanded  to  include  grade  2  during  the  second 
year*    These  Sa  had  tvo  years  of  prior  bilingual  education,  of  vhich  one 
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year  was  In  the  Title  VII  program.    Project  staff  reported  that  project 
Ss  were  generally  more  conversant  In  English  than  In  Spanish^  although 
they  lacked  proficiency  In  both  languages.    All  of  the  project  students 
were  LES  and>  presumably^  within  a  normal  range  of  ability;  with  very  few 
exceptions  they  were  all  Chlcanos.    They  were  not  from  migratory  families 
and  thus  constituted  a  very  stable  student  population. 

Instructional  treatment.    The  project  served  all  of  the  district's 
LES  students  with  assessed  limited  English-speaking  proficiency  in  grades 
Kr-Z^    Project  students  were  in  integrated  classrooms  yet  they  received 
most  of  their  instruction  through  language-proficiency  grouping  within 
the  classroom  in  K  and  across  grade-level  classrooms  in  first  and  second 
grades . 

Project  instruction  stressed  basic  skill  development.    This  emphasis 
conformed  with  the  district's  instructional  orientation.    Instruction  was 
not  influenced  in  any  noticeable  way  by  the  PIP.    District  policy  stressed 
reading  as  a  priority  subject  area;  the  district  had  a  reading  continuum 
for  grades  1^5  for  English  reading.    Moreover^  the  district  had  recently 
adopted  a  policy  requiring  the  development  o£  performance  objectives;  this 
policy  preempted  a  possible  PIP  influence  of  their  instructional  program. 

During  the  first  year»  there  were  six  K  and  six  first-grade  class- 
rooms in  this  project.    Project  Ts  were  organized  into  two-person  teams 
that  paired  a  monolingual  English  and  a  bilingual  Spanish- English  Ts*  All 
Spanish  language  instruction  was  done  by  bilingual  Ts.    In  monolingual  T's 
classrooms^  TA  often  initiated  and/or  reinforced  lessons  in  Spanish.  All 
grouping  in  subject  areas  was  by  ability  in  most  cases.    During  the  second 
year^  there  were  five  K  classrooms^  six  first  and  five  second  grade  class- 
rooms.   First  grade  project.  Ts  were  paired  into  two-person  teams  comprised 
of  a  monolingual  English  and  a  bilingual  Spanish- English  T.    There  were 
two  such  teams  in  K  and  in  second  grades^  respectively.    In  each  of  these 
two  grades^  one  project  T  functioned  within  a  self-contained  classroom. 
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Reading  and  language  arta  were  regarded  aa  diatinct  aubjecta  at  thia 
project  aite*    A  diatrict-'adopted  oral  language  program  (LEIR)  was  uaed  in 
most  firat  and  aome  of  the  aecond  grade  project  claaarooma*    The  inajority 
of  the  project  atudenta  received  their  initial  inatruction  in  Engliah  and 
reinforcement  in  Spaniah*    In  grade  1»  project  students  received  an  hour 
or  niore  of  Spaniah  reading  and  language  development  as  well*  Inatruction 
in  reading)  math  and  language  arta  waa  done  in  amall  groups;  activity  cen** 
tera  were  commonly  used  for  moat  leaaona*    In  grade  1|  aome  of  the  project 
students  were  pulled  out  to  get  Engliah  reading  inatruction  from  a  Title  I 
reading  apecialist  during  the  firat  year* 

Inatructional  time  devoted  to  language,  arts  varied  from  a  minimum  of 
two  hours  to  three  houra  and  forty  minutes  daily*    Of  this»  the  amount  of 
time  allocated  to  Spaniah/English  basal  reading  instruction  varied  from 
one  hour  to  one  hour  and  fifty  minutes  daily*    Math  Inatruction  varied 
from  twenty  minutes  daily  to  thirty^five  minutes  four  daya  a  week* 
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VENCEREMOS  -  SITiS  C 

PROJECT  SUMMARY 
1977-1978  and  1978-1979 

Setting*    Site  C  is  a  small»  fast  growing  community  with  an  annual 
population  growth  rate  exceeding  13  percent.    This  expansion  is  due  to 
industrial  and  agricultural  growth  in  the  area.    The  school  district  was 
comprised  of  six  elementary  schoola,  two  junior  high  schools  and  one  high 
school.    Over  17  percent  of  the  elementary  enrollment  in  the  district  is 
Chicano»  most  o£  which  is  concentrated  in  three  of  the  elementary  schools. 
Chicano  enrollment  has  increased  district-wide  by  over  three  perc^t  an- 
nually in  recent  years. 

Overview.    Conditions  in  this  district  favored  the  installation  of  a 
bilingual  education  project.    The  district  had  twice  atte^npted  to  submit 
a  Title  VII  proposal  for  funding.    The  district  was  generally  progressive 
and  had  prior  contact  with  the  Venceremoa  origination  site.    The  district 
had  a  migrant  pull-out  program  with  a  well-trained  bilingual  staff  and  had 
a  competently  staffed  evaluation  unit.    In  early  fall  of  the  second  year» 
the  project  director  and  project  secretary  quit  the  projectj  this  action 
destiibilized  the  management  and  coordination  o£  the  project  throughout 
the  first  half  of  the  academic  year. 

Decision  makers.    None  of  the  district  decision  makers  were  bilingual 
or  bicultural.    The  superintendent  was  supportive  of  the  project  but  only 
nominally  involved*    The  prime  movers  for  project  adoption  were  the  dis*- 
trict's  federal  project  officer  and  district  evaluator.    The  district 
manifested  a  strong  interest  in  installing  a  bilingual  education  project 
although  not  necessarily  in  replicating  a  pip  project.    The  level  of  dis- 
trict commilment  to  bilingual  education  generally  was  strong;  the  dietrict 
saw  bilingual  education  as  a  way  of  meeting  the  special  needs  of  a  segment 
of  its  students. 

Project  director.    Ihe  project  director  hired  the  first  year  was  a 
Chicana;  she  was  bilingual  and  had  previously  worked  for  two  years  as  a 
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curriculum  and  InBtructional  trainer  with  the  federal  training  resource 
center  (TRC)  in  che  region*    Prior  to  that»  she  was  b  bilingual  claBBroom 
teacher  for  Beveral  years*    She  had  no  Bpecific  training  or  direct  experi-^ 
ence  in  project  management)  although  ahe  waB  generally  effective  aB  a 
project  director*    Ber  manBgeoent  Btyle  and  role  were  not  influenced  by 
the  ?IP  in  any  BignificBnt  way*    Thia  PD  reBigned  her  Job  in  early  Octo*- 
ber»  1978*    The  PD  poBition  waB  VBcant  for  almoBt  four  montha^  the  exiBt- 
ing  project  InBtructional  conBultant  (IC)  Bttempted  to  fulfill  both  the 
PD  and  IC  roleB*    Mld-ycar»  b  new  PD  waB  hired*    He  waB  the  preBent  IC'b 
huBband*    Like  hia  predeceaaor»  thiB  PD  had  no  Bpecific  training  or  direct 
experience  in  project  management*    He  was  formerly  a  claBBroom  teacher  in 
the  diBtrict  yet  had  Bome  graduate  training  and  experience  in  educBtion 
BdmlniBtrBtion*    In  apite  of  thiB»  the  diBtrict  deciaion-^kerB  regarded 
him  aa  primarily  b  teacher  and  Btudent  counBclor^    giB  attemptB  to  inter-* 
vene  directly  in  clBBBroom  inBtruction  and  hiB  inBiatence  on  teacher  com** 
pliance  to  hiB  directiveB  alieitated  him  from  moBt  of  the  project  Tb*  An 
outBide  obBerver»  a  TRC  trainer*  reported  that  thiB  PD  puahed  too  hard 
and  had  an  abraBive  management  Btyle* 

Project  Bupport  BtBff*    The  project  Bupport  ataff  conBiBted  of  a 
pBrBprof eBaional  community  liaiBon  (CL)  and  a  project  evaluator  (EV)* 
The  diatrict  initially  planned  to  hire  an  InBtructional  conBultant  (IC}» 
aa  Bpecified  in  the  PIP>  but  could  not  find  a  auitBble  BpplicBnt  until 
midwBy  through  the  academic  yeBr* 

The  CL  waB  ChicanB  and  bilingual »  maintained  contact  between  the 
project  Bnd  parenta  and  also  acted  aB  b  quBBi  achool  Bocial  worker*  ThiB 
Btaff  poBition  waB  not  PIP  apecified,  yet  the  CL  role  for  thiB  v^oJe<^^ 
waB  influenced  by  the  role  performed  by  the  migrant  educBtion  proJect'B 
CL*    ThuB  the  CL  role  waB  Blready  defined  and  establiBhed  in  the  district* 
The  EV  waB  already  employed  by  the  diatrict  and  waB  written  in  aB  half*- 
time  evaluator  for  thiB  project*    He  waB  highly  competent  and  aupportive 
of  the  project*    He  alBo  often  led  the  diBtrict'a  propoBal  writing  team 
effortB  and  waB  thus  highly  knowledgeable  of  diBtrict  policieB  and  proce-^ 
dureB*    He  waB  an  important  aBSet  and  made  an  important  contribution  to 


363 


VENC-C...3 


the  project.    His  presence  and  support  for  the  project  provided  much 
needed  continuity  during  the  second  year. 

During  the  second  year»  a  new  CL  was  hired.    She  wes  Chicana  and  bi- 
lingual and  assumed  all  the  duties  of  the  previous  CL.    The  IC  was  Chicana 
and  bilingual;  she  had  prior  experience  both  as  a  bilingual  classroom 
teacher  and  as  a  bilingual  resource  teacher.    She  performed  the  dual  PD 
and  IC  role  u&lil  mld^year.    She  was  competent  and  effective  with  the 
project  Is* 

The  staff  configuration  and  roles  of  the  project's  support  staff  were 
not  influenced  in  any  major  way  by  the  PIP  specifications  and  guidelines. 

Project  instructional  staff.    All  of  the  four  project  teachers  (Ts) 
during  the  first  year  were  ChicanaB  and  bilingual.    Three  of  the  four 
were  already  employed  in  the  district;  one  of  these  three  worked  as  a 
teacher  with  the  migrant  program.    The  fourth  teacher  was  a  credentialed 
T  working  as  an  aide»  also  with  the  migrant  program.    None  of  these  Ts 
were  trained  as  bilingual  Ts.    Although  they  were  all  competent  and  effec* 
tive  Ts»  two  of  them  appeared  not  to  be  very  cofmnitted  to  the  project  and 
resisted  the  directives  of  the  younger  and  less  experienced  project  direc- 
tor.   These  two  Ts  were  participating  in  a  Teacher  Corp  program  to  obtain 
their  master's  degrees.    The  other  two  Ts»  particularly  the  former  teacher's 
aide  (TA}>  were  receptive  to  and  welcomed  the  project  director's  efforts 
to  assist  them.    This  teacher  taught  a  regular  K  class  in  the  morning  and 
a  bilingual  K  class  in  the  afternoon.    Each  of  the  Ts  had  a  TA  who  had  an 
instructional  role  in  the  classroom.    All  the  TAs  were  Chican«s»  bilin- 
gual and  were  effective  in  the  classroom.    One  of  these  TAs  was  attending 
college  and  working  towards  a  credential.    Another  TA  was  also  a  project 
parent  and  <.n  officer  of  the  project's  parent  advisory  committee. 

The  hiring  of  one  project  T»  the  reassignment  of  another  T  and  the 
hiring  of  all  the  four  project  TAs  was  done  in  late-summer  due  to  late 
funding.    There  was  very  little  time  in  which  to  prepare  adequately  fof 
the  beginning  of  school*    With  the  exception  of  the  project  director's 
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guidance  to  the  two  receptive  Ts,  the  PIP  Influence  on  the  Ts'  role  and 
Instruction  was  negligible. 

Durlqg  the  second  year^  the  project  was  expsnded  to  Include  two 
second  grade  classrooms.    The  two  addltlonsl  project  Ts  were  neither  bi- 
lingual nor  blcultural  yet  both  had  training  In  bilingual  education.  One 
had  several  years  experience;  the  other  was  a  brand  new>  Inexperienced  T* 
Both  were  new  to  the  district.    However,  both  T  appeared  to  be  very  com- 
mitted to  the  project*    One  In  psrtlcular  was  extremely  well  organized 
and  devoted  a  lot  of  additional  time  to  her  work.    They  were  both  compe- 
tent and  effective  Ts» 

Other  personnel  (regular  staffs  community^  parents) *    The  project  was 
located  at  two  schools*    One  of  the  principals  (P)  was  Initially  skeptlcsl 
of  the  project.    Halfway  through  the  first  year»  he  became  supportive^  and 
later  was  enthusiastic  about  the  project  and  very  supportive,  having  ob* 
served  the  project  Ts  commitment  and  hard  work.    The  other  P  was  generslly 
neutrsl  toward  the  project*  as  were  the  regular  Ts  at  both  schools.  They 
were  neither  enthusiastic  nor  obstructive  of  the  project.    For  the  most 
part»  the  regular  staff  was  only  superficially  Informed  about  the  project. 
A  major  source  of  support  for  the  project  came  from  the  district's  migrant 
education  project  personnel.    There  was  a  close  and  supportive  relation- 
ship among  the  migrant  and  bilingual  education  staffs  at  both  schools  how^ 
ever  the  cooper a tlveness  by  migrant  education  project  management  personnel 
dissipated  considerably  during  the  second  year. 

Many  of  the  parents  of  children  served  by  the  project  lived  a  good 
distance  from  the  schools.    Some  still  lived  year*round  In  labor  camps 
In  the  area.    Parent  psrtlclpatlon  was  limited  to  a  few  members  serving 
on  the  project's  parent  advisory  committee  (PAC).    The  PAC  was  formed  by 
the  PD  and  CL;  Its  function  was  largely  procedursl. 

Other  resources  (materials/equipment,  facilities,  funds).  The 
English- langusge  materials  used  In  the  project  were  already  In  use  In  the 
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district*  The  Spanif h*langu&ge  m&teri&ls  used  by  the  project  were  influ-' 
enced  It^rgaly  by  the  project  directors'  prior  experience,  and  to  some  ex- 
tent, by  the  district's  migrant  education  program*  Both  project  directors 
were  well  Informed  on  available  materials  In  bilingual  education  and  drew 
on  this  experience  to  tnake  appropriate  selections  for  the  project*  PIP 
guidelines  anc  recommendations  did  not  Influence  the  selection  of  materi- 
als In  any  noticeable  way*  The  equipment  used  In  the  project  was  already 
In  use  In  the  district* 

The  project  was  situated  at  two  of  the  district's  six  elementary 
schools*    The  six  project  classrooms  were  large,  well  equipped  and  ade* 
quat^^  for  project  Instruction*    The  PD's,  CL's  and  EV's  offices  were 
located  In  a  modern,  district  building  that  housed  all  of  the  district's 
special  projects*    The  available  space  was  limited  but  adequate  and  com- 
pared equally  to  that  available  to  all  the  other  special  projects  In  the 
district* 

Project  funds  were  allocated  In  late-summer  of  the  first  year*  This 
created  staffing  problems  because  the  PD,  TAs,  two  Is,  and  the  CL  were  not 
hired  until  shortly  before  Instruction  began* 

Plans  and  constraints*    State  education  code,  federal  bilingual  rules 
and  regulations,  and  district  policy  Sulded  the  project  Implementation* 
The  Increasing  minority  enrollment  In  several  of  the  district's  el^entary 
schools  caused  the  district  to  take  voluntary  and  preemptive  moves  to  pre* 
vent  segregated  schools  In  the  district* 

Midway  through  the  first  year,  the  local  teachers'  union  won  an  agree- 
ment that  required  all  mid die -management  district  personnel  to  convey  all 
directives  Intended  for  project  Ts  as  recommendations  through  the  school 
principal*    This  action  limited  the  project  director's  direct-line  author- 
ity to  the  project  teachers* 

There  were  no  Office  of  Education  sanctions  for  replicating  the  PIP 
and  the  district  was  only  nominally  Interiisted  In  doing  so*    The  PIP 
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influenced  the  hiring  of  TAs,  the  PD,  IC  and  the  EV;  it  alto  influenced 
the  number  of  staff  development  workshops  held  but  not  their  content* 
The  PIP  impact  on  classroom  instruction  was  negligible* 

Students*    All  of  the  project  students  uere  presumably  within  a  nor** 
mal  range  of  ability*    With  very  few  exceptions,  they  were  all  Chicanos* 
Thlrty*nine  percent  of  the  Chicano  students  in  the  district  were  classi- 
fied as  migrants*    All  of  the  project  students  scored  low  on  an  English- 
language  proficiency  test*    Comparable  data  on  Spanish- language  profi* 
ciency  suggests  that  project  Ss  varied  considerably  in  their  Spanish- 
language  proficiency* 

Instructional  treatment*    The  project  instruction  received  by  the 
children  stressed  oral  language  development  and  basic  skills*    The  PIP 
impact  on  classroom  instruction  was  negligible*    Project  Ts  in  grades  1 
and  2  operated  self**contained  classrooms;  they  t>sed  their  TAs  to  reinforce 
instruction*    A  few»  unspecified  number  of  project  students  received  the 
majority  of  their  instruction  in  Spanish*    All  grouping  was  done  by  ability 
within  language  groups*    There  were  two  first  grade  and  two  second  grade 
classrooms  in  the  project*  divided  equally  among  two  district  schools* 

Reading  and  language  arts  were  regarded  as  distinct  subjects*  The 
majority  of  project  students  received  their  instruction  in  English*  In 
addition*  project  students  received  £SL  or  SSL  instruction*  depending  on 
their  language  proficiency*    In  grade  l»  project  students  were  taught 
English  and  Spanish  reading*    Instruction  in  rending*  language  arts  and 
math  occurred  in  small  groups;  reading  instruction  was  individualized  to 
the  extent  possible*    Activity  and  listening  centers  were  used  extensively 
at  this  site*    An  unspecified*  although  small  number  of  project  students 
received  special  reading  and*  to  a  lesser  extent*  math  instruction  on  a 
pull  out  basis  from  the  schools'  migrant  resource  room* 

Reading  instruction  in  the  migrant  resource  room  &nd  in  one  of  the 
two  second-grade  classrooms  employed  the  Guzack  method  of  individualized 
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reading  instruction*    Instruction  in  this  same  grade  2  classroom  was 
organized  around  student  contracts  and  learning  centers* 

Instructional  time  devoted  to  reading  and  language  arts  varied  across 
classrooms  And  grade  levels*    In  grade  I»  thirty  minutes  vere  devoted  to 
English  reading  and  20  to  30  minutes  to  Spanish  rea<Sing*    Twenty  minutes 
were  devoted  to  ESL  or  SSL  instruction  and  thirty  minutes  allocated  to 
math  instruction*    Hath  instruction  was  conducted  in  either  Spanish  or 
English*  depending  on  the  studenta^  language  proficiency*    One  of  these 
firat  grade  classrooms  devoted  fifteen  to  thirty  minutes  alternately  to 
penmanship  and  library  visits  several  days  of  the  week*  and  fifteen  min- 
utes twice  a  week  to  Spanish  singing* 

Altogether,  from  one  hour  and  twenty  miitutes  to  one  hour  and  fifty* 
five  minutes  daily  were  devoted  to  language  arts  and  reading  combined  in 
grade  i*    In  grade  2»  a  total  of  two  hours  and  twenty  minutes  daily  were 
devoted  to  language  arts  and  reading  combined*  daily,  with  one  hour  of 
that  time  devoted  explicitly  to  reading*    Twenty  minutes  daily  were  de* 
voted  to  SSL  and  to  ESL  inatruction*  respectively*  and  also  to  English 
language  arts*    Twenty-five  minutes  were  allocated  for  math  instruction 
daily* 
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VENCEREMOS  *  SITE  D 


psoject  summary 

1977-1978  and  1978-1979 


Setting.    Site  D  la  a  amall,  rural,  mostly  unincorporated  exurb* 
Twenty*£our  percent  of  the  atudenta  In  the  district  are  Chlcanoa.  The 
district  has  three  elementary  achoola,  one  middle  school,  one  Junior  high 
school  and  one  high  school.    The  project  school  has  a  Chlcano  student 
enrollment  of  48  percent,  compared  to  15  and  25  percent  at  the  two  other 
eletnentary  schools* 

Overview*    This  site  had  a  state-funded  bilingual  project  for  the 
previous  two  years  that  extended  from  K  to  grade  4«    The  PIP  project 
Installed  In  the  district  was  a  K-3  project  the  first  year  and  expanded 
vertically  Into  grade  4  the  second  year*    The  project  school  was  an 
Individually  guided  education  (IGE)  school  and  featured  team*orlented. 
Individualized  Instruction.    The  project  staff  was  competent  and  the 
project  ran  smoothly  both  years* 

Decision  makers*    The  superintendent  wae  supportive  of  bilingual 
education  and  for  several  years  had  been  gradually  preparing  the  district 
for  Installing  a  bilingual  project.    He  committed  district  funds  to  hire 
two  teachers  on  an  extended  210  day  contract'^*25  days  more  than  a  regular 
contract^^^to  prepare  Instructional  materials*    Other  district  decision 
makers  (DMd)  were  generslly  supportive  of  bilingual  education.  Conditions 
In  the  district  favored  the  Installation  of  a  bilingual  education  project, 
however  district  decision  makers  were  not:  very  interested  In  replicating 
a  PIP  project*    The  prospects  of  Increasing  their  chances  for  Title  VII 
funding  led  them  to  adopt  a  Pip  project* 

District  DMd  chose  the  Venceremos  PIP  because  of  Its  similarities 
to  the  IGE  concept  already  present  In  the,  district  and  because  of  Its 
perceived  match  to  the  characteristics  of  the  student  population  In 
the  proposed  project  school.    IGE  Is  a  team^^teachlng ,  d^mocra€lcally- 
oriented  approach  to  Individualized  Instruction. 
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Project  director.    The  project  director  (PD)  was  a  Chlcana  who  was 
formerly  employed  as  a  curriculum  and  staff  development  specialist  In  a 
large*  very  progressive  and  predominantly  Chlcano-staf fed  school  district 
In  the  nearby  metropolitan  area.    While  the  PD  had  no  prior  training  or 
direct  experience  In  project  management*  she  was  a  strong*  enthusiastic 
administrator  and  supporter  of  bilingual  education  and  was  very  well  con- 
nected to  regional  and  state  support  and  advocacy  networks  In  bilingual 
education.    She  was  a  very  effective  PD  and  created  a  climate  of  enthu- 
siasm for  the  project*  both  among  the  project  staff  and  the  r^ular  staff. 
The  PD  essentially  defined  her  own  rolei  her  mnnagement  style  Bitd  role 
were  not  Influenced  by  the  PIP  specifications  and  guidelines  to  any  no- 
ticeable extent* 

Project  support  staff.  The  project  support  staff  Included  a  para- 
prof  esslonal  parent  coordinator  (PC)*  a  project  secretary  (PS)»  a  full- 
time  Instructional  coordinator  (IC)  and  an  evaluator  (EV)  contracted  to 
conduct  the  project  evaluation. 

The  PC  role  waa  not  specified  In  the  PIP.    The  PC  was  a  Chlcana* 
parent  of  a  project  student  and  was  very  active  In  school  and  community 
affairs,    she  performed  her  role  as  liaison  between  the  project  and  par- 
ents very  well.    At  the  end-of  the  first  year*  she  was  offered  a  position 
as  teachers-assistant  (TA)  In  the  project.    The  PS  was  Chlcana*  parent  of 
a  project  student  and  very  efficient  and  helpful.    The  IC  during  the  first 
year  was  formerly  a  regular  teacher  In  the  district's  middle  school  and 
had  considerable  experience  In  curriculum  development  yet  had  no  formal 
training  In/or  experience  with  elementary*  bilingual  curriculum.    She  was 
hired  In  mid-year  and  provided  some  direct  Instructional  assistance  to  the 
project  teachers  yet  concentrated  primarily  on  directing  staff  development 
activities.    In  January  of  the  second  year*  this  IC  resigned  her  post  and 
was  replaced  by  the  projects'  second**grade  T.    The  second-grade  position 
was  filled  by  an  experienced  bilingual  T.    She  was  bilingual  and  Chlcana. 
She  had  a  bilingual  teaching  credential  and  had  taught  In  a  bilingual  pro- 
gram In  the  late  slxtlea;  her  most  recent  experience  was  as  an  ESL  teacher 
In  an  adult  education  setting.    The  EV  was  a  private  consultant  with 
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considerable  expertise  snd  experience  in  bilingual  education  evaluation* 
He  was  based  in  a  city  one  hour  away^    While  he  performed  his  job  very  ef- 
ficiently»  he  was  not  readily  svailable  to  the  PD  for  consulation  except 
during  specified  on**8ite  meetings  since  he  was  very  over  commit  ted  and  busy* 
Be  was  also  contracted  to  perform  the  project  evaluation  for  the  second 
yesr^    He  coordinsted  the  fsll  pretesting  of  project  children  yet  he  was 
unavsilable  after  that^    As  a  consequence*  the  PD  decided  to  hire  another 
EV  to  complete  the  project  evaluations*    This  £V  was  bilingusl  snd  Chicano 
snd  was  very  knowledgeable  and  competent  in  the  evsluation  of  bilingual 
education  programs^    The  PC  position  was  filled  by  a  bilingual  Chicana  who 
resigned  mid-year*    She  was  replaced  by  another  bilingual  Chicana*  These 
PCa  assumed  all  the  functions  performed  by  the  PC  during  the  previous 
yesrs^    They  performed  their  job  efficiently* 

The  staffing  configuration,  but  not  the  roles  of  the  project  staff, 
was  influenced  by  the  PIP^    The  PC  position  was  notably  not  PIP-specif led* 

Project  instructio;ial  staffs    During  the  first  year  all  of  the  four, 
K-3  project  teachers  (Is)  were  trained  in  bilingual  education*    At  year's 
end,  all  had  esmed  s  master's  degree  in  bilirgual  education*    Two  of  the 
four  Is  were  Chicanas;  sll  four  were  bilingual  yet  one  of  them  only 
moderately  fluent  in  Spanish^    All  four  Is  were  experienced  bilingual  Is, 
having  taught  in  the  school's  state^funded  bilingusl  education  project  for 
the  previous  two  yesrs^    These  four  Is  were  assigned  to  be  the  Title  VII 
project  Ts*    All  four  were  committed  to  the  project  and  were  effective  Ts* 
A  strong  feeling  of  solidarity  existed  among  these  Ts»  largely  as  a  result 
of  their  common  endeavors  in  working  toward  their  master's  degrees  snd 
their  prior  years  of  teaching  in  the  atate-funded  bilingual  educstion 
project  in  the  school*    Their  prior  experience  and  current  university 
training  were  the  major  influences  in  their  instructional  roles*    The  PIP 
had  no  noticeable  Impact  on  classroom  instruction* 

A  teacher-aide  (TA)  was  assigned  to  each  project  T*    These  four  TAa 
were  Chicanss  and  bilingual*    One  of  the  TAs  wss  formerly  a  Title  I  aide; 
another  TA  had  been  a  secretary  in  the  district  office;  another  one  had 
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served  as  a  volunteer  and  substitute;  and  the  fourth  was  a  new  hire.  How* 
ever*  all  four  TAs  were  hired  and  assigned  to  the  project  after  a  regular 
competetive  selection  and  hiring  process.    All  of  them  were  strongly  aup-^ 
portive  of  the  project  and  performed  their  instructional  roles  efficiently. 
Although  the  TA  instructional  role  was  already  established  in  the  district* 
the  PIP  reinforced  this  TA  role  in  the  project. 

The  project  expanded  into  the  fourth  grade  during  the  second  year. 
The  fourth-grade  T  was  bilingual  and  Chicana.    She  had  training  in  bilin^ 
gual  education  and  had  state  bilingual  endorsement.    She  had  recently  re- 
ceived her  teaching  credential  and  this  was  her  first  teaching  job.  Her 
TA  was  the  projects  PC  during  the  previous  year. 

Other  personnel:  regular  staff,  cocmiunityt  parents.    The  proje^:^  was 
located  in  one  of  the  district's  three  elementary  schools.    The  principal 
(p)  during  the  first  year  was  a  very  dynamic*  innovative  person  who  was 
very  supportive  of  the  project.    She  developed  a  close  working  relation- 
ship with  the  PD.    This  P  took  s  leave  of  absence  during  the  second  year; 
her  replacement  was  also  very  supportive  of  and  cooperative  with  the  proj- 
ect staff.    Instruction  in  the  project  school  was  team-oriented  snd  the 
project  Ts  had  considerable  contact  with  the  regular  Ts.    Planning*  sche- 
duling and  instruction  were  conducted  by  grade-level  teams  in  all  areas 
except  language  arts.    In  this  arrangement*  non-project  Ts  had  to  evaluate 
project  Ts  and  vice  versa.    In  general,  the  regular  Ts  regarded  the  proj- 
ect favorably.    Initial  tensions  over  the  lunchroom  and  playground  duties 
of  the  project  TAs  were  readily  dissipated  when  the  nondassroom  duties  of 
all  TAs  were  assigned  equally.    The  regular  staff  influenced  the  project 
in  a  major  way  because  they  taught  project  students  in  areas  other  than 
language  arts. 

Parent  participation  by  project  parents  in  the  district  was  minimal 
prior  to  the  project's  installation.  The  project's  parent  advisory  com- 
mittee (PAC)  was  formed  by  the  PD  and  consisted  of  those  parents  who  at- 
tended an  initial  project  briefing  by  the  PD.    One  day  of  the  pre-service 
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session  was  devoted  to  formulating  strategies  to  increase  parent  partici^ 
pation*    Throughout  the  first  year,  the  level  of  parent  participation  in* 
creased  as  more  project  parents  were  recruited*    The  PC  and  IC  had  ongoing 
contact  with  the  parents  and  held  several  parent  education  workshops* 
Some  parents  were  involved  informally  aa  classroc/  volunteers*    By  year'a 
end,  evidence  of  parental  support  for  the  project  was  visible*    This  level 
of  participation  extended  through  the  second  year* 

Other  resources!  materials/equipment,  facilities*  funds*  Initially, 
the  majority  of  the  instructional  materials  used  in  the  project  were  al* 
ready  in  use  in  the  project  school*    The  Spanish^ language  materials  in 
use  were  mostly  those  used  in  the  state-funded  bilingual  education  proJ<" 
ect  in  previous  years*    The  project  conducted  a  needa  assessment  of  their 
curriculum  materials  and  used  th^  findings  to  guide  tbeir  purchases  of 
materials  for  content  areas  in  both  languages  to  fill  in  the  gaps  in 
project  materials*    The  selection  ot  those  project  materials  was  also 
influenced  by  the  SEA's  area  service  center  that  provided  technical  as- 
sistance and  staff  training  to  state  and  federal  bilingual  projects  in 
the  designated  area*    Another  major  influence  was  the  bilingual  education 
program  at  a  nearby  university  in  which  the  project  Ts  were  enrolled; 
another  influence  was  the  Innovative  practices  of  school  districts  in  the 
region*    The  PIP  recommendations  and  guidelines  were  Judged  by  the  project 
Ts  to  be  dated,  vague  and  generally  inadequate,  and  were  not  used  for  me* 
terial  selection  or  to  guide  instruction*    When  PIP  objectives  were  com- 
pared to  existing  district  performance  objectives,  the  project  regarded 
their  scope  and  sequence  and  instructional  objectives  as  far  superior  to 
those  recommended  by  the  PIP*    The  PIP  objectives  were  correlated  with 
the  existing  objectives;  these  performance  objectives  were  then  used  by 
project  Ts  to  guide  instruction*    The  equipment  in  use  in  the  project 
classrooms  was  largely  already  in  place  in  the  district* 

The  project  classrooms  were  quite  adequate;  all  of  them  were  quasi- 
open  classrooms;  they  were  adjacent  t:o  regular  classrooms  and  were  sep** 
arated  by  a  partial  wall*    The  project's  office^  was  small  and  a  bit 
crowded  but  was  adequate  and  well  equipped* 
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Project  funds  were  received  in  midsussmer  and  permitted  adequate  time 
for  preparation  of  in-service  workshops*    However,  the  project  Ts'  pre- 
vious experience  and  available  materials  and  lesson  plans  permitted  the 
Ts  to  cope  well  with  the  hasty  start-up  and  initial  operation  activities* 

In  the  fall  of  1977»  the  project  received  an  unsolicited  allocation 
of  $35,000  to  augment  the  underbudgeted  project  funds*    These  funds  were 
used  to  hire  a  full-time  IC  and  a  half~time  PC»  and  to  purchase  office 
furniture,  audiovisual  equipment  and  materials  for  learning  centers* 

Plans  and  constraints*  The  stste  education  codes,  state  and  federal 
bilingual  education  rules  and  regulations  and  local  district  policies  and 
practices  guided  the  project's  implementation*  The  number  but  not  the  con- 
tent of  staff  development  activities  was  PIP-inf luenced ,  as  was  the  proj*- 
ect's  stsff  configuration*  Otherwise,  PIP  recommendations  and  guidelines 
had  a  negligible  effect  on  the  project*  The  project  derived  its  direction 
from  the  PDs'  and  the  district's  prior  experience  in  bilingual  education* 

Students*    The  majority  of  the  project  students  were  presumably  with*- 
in  a  normal  range  in  ability*    With  few  exceptions,  they  were  all  Chicano* 
They  were  not  from  migratory  families  and  w&re  thus  a  stable  student  popu- 
lation*   There  were  only  a  few  monolingual  Spanish^speaking  students,  yet 
all  the  project  atudents  scored  low  on  an  Bnglish*language  proficiency 
test*    Project  Ts  reported  that  the  Ss  also  were  not  very  proficient  in 
Spanish*    The  project  served  grades  K-3  the  first  year*    With  the  excep* 
tion  of  incoming  students  in  K  and  other  grades,  all  lat  through  3rd  grade 
project  Ss  were  previously  served  by  the  dtate^funded  bilingual  education 
project  in  the  school*    The  project  expanded  into  grade  4  during  the  second 
year*    These  students  had  one  year  of  prior  instruction  in  the  Title  VII 
bilingual  education  program  and  three  years  of  bilingual  inatruction  in 
the  3tate**f unded  program* 

Instructional  treatment*    The  project  instruction  received  by  project 
children  stressed  baaic  skills  development*    The  PIP  impact  on  classroom 
instruction  was  negligible* 

374 


VENC-D***7 


At  this  site  all  non-bilingu?!  instruction  was  conducted  by  grade- 
level  teams*    In  this  arrangement,  project  students  received  reading  and 
language  arts  instruction  from  project  Is  and  all  other  instruction  from 
grade- level  teams*  which  include  their  project  Ts*    Project  Ts  in  grades 
1  and  2  were  experienced,  trained  bilingual  Ts*    Project  Ts  conducted  in- 
struction and  used  their  TAa  to  reinforce  this  instruction*    All  grouping 
of  project  students  was  by  ability*    There  was  only  one  classroom  per  grade 
level  in  this  project* 

Rt^ding  and  language  arts  instruction  were  regarded  as  a  unified  sub* 
ject  and  conducted  in  on<s  block  of  instructional  tJjne*    With  very  few 
exceptions,  project  students  received  instruction  in  English*  However, 
for  language  arts,  all  project  students  received  both  Spanish  and  English 
language  arts  instruction*    This  instruction  was  conducted  in  smsll  groups,* 
within  groups,  reading  was  individualized  to  the  extent  possible*  Listen* 
ing  and  activity  centers  were  commonly  used  for  language  arts  instruction* 
A  district"adopte<l  reading  system,  the  Peagus  system,  was  used  for  English 
reading  instruc\:ion*    Special  Title  IV  funds  were  available  for  training 
Ts  and    purchasing  materials  under  a  Right  to  Resd  grant* 

Grade  1  devoted  one  hour  and  forty  ininutes  to  English  language  arts 
and  one  hour  and  twenty  minutes  to  Spanish  language  arts  instruction 
daily*    Grade  2  devoted  and  additional  fifteen  minutes  daily  to  silent 
reading  in  English*    Both  grades  1  and  2  devoted  one  hour  daily  to  math 
instruction* 
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APPENDIX  B 

Flrst"Year  Advisory  Panel  Rficommendatlons 

The  advisory  panel  consisted  of  ten  representatives  from  the  fields 
of  bilingual  education  and  ccmmunlcatlons*    They  were  chosen  to  insure 
that  the  views  from  various  language  groups »  different  geographic  areas» 
and  distinct  areas  of  expertise  were  represented*    A  complete  list  of  the 
panel  members  will  be  found  In  Table  B-3*    Each  panel  member  is  listed  as 
participating  In  one  working  cotmnlttee^  but  all  panel  members  contributed 
to  the  general  discussions*    The  panel  met  for  two  days  at  the  close  of 
the  first  year  of  the  PIP  implementation  study»  and  again  to  review  the 
draft  final  report*    This  appendix  describes  the  first  meeting*  which  af* 
fected  the  direction  of  the  second  year  of  the  study*    The  panel  also  had 
a  major  impact  on  the  content  and  organization  of  the  final  report* 

The  advisory  panel  comments  are  summarized  on  the  pages  that  follow 
together  with  summaries  of  BMC  presentations  to  which  the  panel  responded* 
Panel  members  were  not  always  in  agreement*  so  certain  statements  may 
represent  the  views  of  only  one  or  two  people  and  may  contradict  other 
statements* 

The  panel  members  tended  to  consider  the  problems  presented  in  the 
broadest  application  possible  and  not  limit  their  comments  to  the  much 
narrower  concerns  cf  the  study;  therefore*  not  all  of  the  suggestions  are 
within  the  scope  of  the  study*    However*  valuable  ccHoments  were  received 
in  the  area  of  PIP  revisions  and  student  evaluation*    In  other  areas*  BHC 
recommendations  were  confirmed* 

Panel  comments  are  presented  in  four  sections  corresponding  to  the 
four  subcommittees  in  which  panel  members  met:    Target  LEAs*  Projects  and 
Practices*  Delivery  System*  and  Student  Outcome  Evaluation*    Within  each 
section*  the  RMC  study  questions*  findings*  and  reconvnendatlons  precede 
the  panel  comments* 


Target  LEAs 


'^target  LEAs"  refers  to  both  the  LEAs  that  chose  to  adopt  a  project 
via  ^  PIP  and  to  the  pool  of  LEAs  that  form  the  potential  market  for  any 
future  revised  PIFs* 

RMC  Study  Questions  Addressed 

1*    To  what  extent  were  the  projects  chosen  by  the  adopters  appro- 
priate to  those  adopters? 

2*    What  factors  (context,  PIP,  and  other)  influenced  implementa* 
tion  of  the  PIP  projects? 

RMC  Study  Findings 

In  fourteen  of  the  fifteen  Spanish-English  sites,  the  linguistic 
characteristics  of  the  students  being  served  were  comparable  to  those  of 
the  originating  sites*    Many  of  these  students  came  from  homes  where  only 
Spanish  is  spoken,  while  some  came  from  bilingual  home  environments*  Hany 
were  Spanish  dominant  when  they  entered  school*    In  one  of  the  fifteen 
sites,  the  number  of  Limited  English  Speaking  pupils  was  small  relstive 
to  the  total  number  of  students  in  the  project*    In  the  four  French-English 
sites,  the  students  were  not  fluent  in  French  although  French  was  spoken  in 
some  homes*    These  students  differed  somewhat  from  those  of  the  originating 
site,  where  more  French  was  spoken* 

In  many  sites,  the  PIP  projects  called  for  resources  that  were  not 
available  at  the  adopter  sites*    Such  resources  included  skilled,  committed 
bilingual  teachers,  as  well  as  project  directors  experienced  in  administra* 
tion  and  in  bilingual  teaching* 

Most  of  the  adopting  LEAs  were  not  receptive  to  the  idea  of  whole- 
project  adoption*    They  found  it  necessary  to  modify  projects  to  fit 
district  constraints*    Because  of  the  way  they  were  selected  and  the  fact 
that  only  two  languages  are  involved,  the  19  adopter  LEAs  cannot  be  con- 
sidered representative  of  the  total  LEA  market  for  bilingual  projects* 


380 


KMC  Recommends t Ion 


Market  analysis  to  identify  the  size  and  charscteristics  of  the 
populations  to  be  served  as  well  as  the  resources  available  to  LEAa  for 
implementing  projects  should  precede  the  selection  of  exemplary  projects 
for  dissemination^ 

Panel  Recommendations 

The  panel  concurred  with  the  RMC  recommends tions »  but  it  was  stated 
that  even  before  a  market  analysis,  it  was  necessary  to  ask  ''What  do  we 
have  to  offer?*'    Concern  was  expressed  over  the  use  of  the  term  'Wrket*' 
as  this  can  be  interpreted  in  a  narrowi  commercial  senses    KMC  was  using 
the  term  to  mean  any  potential  user  of  revised  PIPs^ 

There  was  concensus  among  panel  members  that  the  PIP  format  as  it 
existed  was  not  well  suited  to  disseminsting  bilingual  programs  of  prac* 
ticest  and  that  substantial  changes  were  necessary^    In  relation  to  target 
LEAb,  panel  members  stated  that  the  PIPs  should  reflect  different  contexts^ 
This  would  mean  that  the  packages,  as  well  as  the  packaged  projects^  would 
be  designed  to  function  in  a  specific  type  of  setting  with  a  specific  type 
of  student  population  4    This  in  turn  would  have  implication  for  the  future 
dissemination  of  PIPs^    Other  suggestions  concerning  PIP  revisions  are 
listed  in  Table  B*2  (under  '^Delivery  Systems"),  together  with  revision 
recommendations  from  the  other  subcommittees « 

Panel  members  disagreed  on  the  most  sppropriate  market  for  revised 
PIPs^    Some  felt  the  materials  should  be  revised  specifically  to  help  newly* 
funded  progrsms,  while  others  ssid  the  market  should  not  be  restricted 
in  any  way^    A  finsl  decision  on  an  appropriate  msrket  for  a  revised  PIP 
depends  on  whether  USOE  wants  to  diffuse  specific,  exemplary  projects  and 
practices  to  LEAs  or  whether  USOE  only  wants  to  respond  to  LEAs'  requests 
for  information^    A  list  of  information  that  is  frequently  requested  by 
LEAs  was  provided  by  the  panel  (Table  8*1)^ 
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Table  B-1 

Information  Frequently  Requested  by  LEAs 


1.    Lists  of  instructionsl  objectives. 

2*    Strategies  to  get  support  from  administrators*  including  lists  of 
good  articles  on  rationale*  research  project  results*  different 
approaches  to  suit  local  political  climate. 

3*    Description  of  the  tescher  training  that  is  available*  Course 

descriptions  that  could  be  offered  to  local  universities*  especially 
of  practical  courses  in  the  methodology  of  home  language  teaching 
in  all  subject  areas. 

4*    Description  of  the  training  that  is  available  for  aides.    An  aide 
training  manual. 

5*    Description  of  state  certification  requirements  and  state  guidelines. 

6.    Suggestions  for  increasing  parental  participation.  • 

7*    Suggestions  for  getting  the  public  to  understand  the  rationale  for 
bilingual*blcultural  education. 

8*    Lists  and  descriptions  of  tests  used  by  bilingual  programs. 

9*    Lists  and  addresses  of  Lau  Centers*  Title  VII  network  centers*  and 
bilingual  education  organizations. 

10*    Descriptions  of  methodology  of  bilingual  education. 

11*    Lists  and  descriptions  of  materials  available.    Information  on  how 

to  assess  and  select  an  appropriate  set  of  materials  for  a  particular 
context. 

12.  Discussion  of  common  pitfalls  of  bilingual  programs  snd  suggestions 
as  to  how  they  might  be  avoided* 

13.  Suggestions  on  how  to  solve  the  problems  of  specific  contexts  such 
as: 

•  new  implementors  with  monolingual  English  speaking  teachers* 

•  new  implementors  with  bilingual  teachers. 

•  LEAs  who  wish  to  upgrade  or  improve  their  bilingual  program. 

•  LEAs  Where  studenta  may  be  bilingual  but  underachievers • 

•  LEAs  Where  students  are  fluent*English  speakers  and  a  bilingual 
program  is  desirable. 

•  LEAs  with  various  languages  represented. 

•  LEAs  who  experience  a  continuous  influi^  of  students  with  limited 
English  skills. 

•  LEAs  with  a  small  number  of  students  with  limited  English  skills 
at  various  grade  levels. 
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Proiectfl  and  Practices 


"Projects  and  practices'*  refers  to  existing  bilingual  education 
methodology^  materials »  techniques*  and  methods  of  project  organization 
that  are  potentially  available  for  dissemioation* 

RMC  Study  Questions  Addressed 

1«    What  kinds  of  practices  or  j>rojects  should  USOE  attempt  to  diffuse 
and  how  should  these  practices  be  selected? 

2«    What  is  the  nature  of  L£A  requests  for  assistance  (e«g«»  identi- 
fication of  effective  practices^  assistance  in  complying  with  regu- 
lations* assistance  in  implementing  projects}? 

BMC  Study  Findings 

Analysis  of  the  three  Spanish-English  PIPs  showed  that  the  three 
projects  as  described  in  the  PIPs»  did  not  differ  significantly*  The 
French-English  project  was  unique  primarily  in  the  language  served*  Dif- 
ferences observed  among  adopter  sites  could  be  attributed  to  contextual 
conditions  and  not  to  PIP*project  specifications*    The  original  descrip- 
tions of  the  three  Spanish-English  PIPs  in  the  ASK  differentiated  them  on 
the  basis  of  student  population  characteristics*    Uowever*  the  procedures 
outlined  in  the  packages  did  not  address  these  differences* 

Adopter  sites  reported  some  common  problems  in  their  efforts  to 
ltt5)lanent  PIP  projects*    The  instructional  component  of  the  PIP  packages 
provided  general  principles »  but  there  was  Very  little  specific  methodology 
that  was  helpful  to  teachers*    Some  of  the  PlP-recommended  instructional 
materials  were  over  five  years  old  at  the  time  of  the  field  test  and  were 
judged  inferior  by  teachers  when  compared  with  other  materials  then  avail- 
able*   Similarly »  some  of  the  features  incorporated  in  the  PIP  projects 
were  considered  out-of-date  because  they  reflected  past  conditions  and 
regulations* 
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The  prerequisites  for  adoption  specified  in  the  ASK  materials*  espe- 
cially a  bilingual  teaching  staff,  were  not  available  at  some  sites.  Many 
sites  did  not  have  a  well  defined  student  selection  procedure  that  incor- 
porated the  use  of  a  language  proficiency  instruments    The  PlP  suggestions 
in  regard  to  student  selection  were  <^ten  incompatible  with  state  law. 

RMC  Recommendations 

If  separate  Spanish**£nglish  PXPs  are  to  be  disseminated*  they  should 
differ  in  significant  ways.    For  example*  different  program  models  could  be 
developed  for  various  types  of  student  populations.    Also,  models  could  be 
developed  that  take  into  account  that  some  LEAs  have  limited  resources*- 
such  as  few  bilingual  teachers  and  limited  expertise.    The  packages  also 
need  to  hsve  more  specific  information  on  bilingual  education  methodology 
in  order  to  be  useful  at  the  classroom  level.    Since  new  materials  are 
constantly  being  developed*  it  would  be  more  useful  to  list  sources  of 
materials  and  provide  guidelines  for  assessment  and  selection  rather  than 
recommend  specific  materials.    Specific  student  selection  procedures  can  be 
described,  but  because  of  various  state  Isws  no  single  procedure  can  be 
recommended.    It  would  also  be  highly  desirable  to  shorten  the  time  span 
between  identification  of  model  projects  and  their  dissemination. 

Panel  R^^rnmnj^dations 

Many  of  the  panel  members^  comments  focused  on  the  need  for  a  better 
fit  between  a  packaged  project  and  local  conditions.    For  example*  they 
felt  different  strategies  were  required  for  different  language  groups 
and  for  students  with  different  degrees  of  proficiency.    They  also  felt 
different  strstegies  should  be  offered  to  districts  with  specific  limita*- 
tions.    For  example,  districts  with  few  bilingual  teachers  could  use  a 
team*teaching  model*  a  roving  bilingual  teacher*  or  especially  well  trained 
aides.    However*  it  should  not  be  implied  that  these  solutions  are  prefer- 
able to  a  staff  of  bilingual  teachers.    Without  exception,  panel  members 
opposed  whole-^project  adoption  and  favored  ?IP  materials  that  would  present 
a  collection  of  alternatives  from  which  sites  could  select.    Panel  members 
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accepted  RMC'b  recoiomendationB  and  offered  additional  suggetions  for  PIP 
revision*    These  cosnnenta  are  sunimarized  in  Table  B*2,  under  "Delivery 
Systems**' 

Two  sdditional  comments  were  offered  by  the  panel*    First,  it  was 
suggested  that  proposal  formats  be  consistent  with  any  project  organization 
system  disseminated  by  USOE*    Second^  the  selection  of  exemplary  projects 
and/or  practices  could  be  Improved  by  involving  teachers  or  other  personnel 
who  have  recently  worked  in  classrooms* 
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DELIVERY  SYSTEMS 

^'Delivery  systems"  refers  to  all  of  the  people  and  materials»  as  well 
as  the  organizations  and  procedures*  involved  in  transporting  exemplary 
projects  and  practices  to  tsrget  LEAs*    The  PIPs  and  the  TRCs  vere  the 
major  coraponenta  of  the  delivery  system  examined  in  this  study* 

RMC  Study  Questions  Addressed 

i*    What  existing  systems  were  in  place  that  complemented  or 
conflicted  with  PIP  dissemination? 

2*    What  piocedurcs  and  resources  were  utilizer!  during  dissem** 
ination? 

3*    What  influenced  adopters  to  adopt  via  PIPs? 

4*    To  what  extent  were  the  programs  selected  appropriate  to 
context  of  the  adopter  sites? 

TtMC  Study  Findings 

There  was  a  mismatch  between  the  intended  audience  for  the  PlPa 
and  the  PIP  content*    For  example*  in  this  tryout»  the  PIPs  were  intended 
for  new*start  Title  VII  projects,  and  yet  the  PIPs  specify  levels  of  staff 
experience  and  administrative  support  not  commonly  found  in  new  projects* 

Users  of  the  PIP  manuals  commented  both  on  the  redundancy  of  the 
material  and  on  the  lack  of  specific  information*    Performance  objectives 
were  too  general  and  there  was  little  information  on  specific  instructional 
techniques*    As  a  result,  the  credibility  of  the  PIP  was  marginal* 

RMC  R**  iflmendations 

The  audience  for  PIPs  should  be  differentiated  on  the  basis  of  prior 
experience  in  bilingual  education,  district  size  and  resources,  and 
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management  orientation*  A  clear  understanding  of  the  intended  audiences 
vould  call  for  different  paclecaging  and  disflemination  fltrategiea  for  dif- 
ferent audiences* 

The  dissemination  strategy  for  PIPs  should  be  coordinated  with  exist* 
ii^g  informatioa»  support*  and  resource  networks  in  the  field  of  bilingual 
education* 

The  packaging  design  should  follov  from  the  overall  diffusion  system 
design  and  should  take  Into  consideration  different  LEA.  attitudes  tovards 
innovation  and  tovards  new  programs*  The  probable  shelf  life  of  the  in- 
formation should  alao  influence  the  kind  of  packaging  used*  Finally*  any 
packaging  effort  should  consider  existing  sources  of  Information  In  order 
to  avoid  duplication* 

Panel  Recommendations 

Panel  members  generally  agreed  with  RMC  recommendations  £  however*  they 
contributed  the  following  additional  comments* 

A  panel  member  who  had  worked  in  the  PIP  dissemination  effort  reported 
that  LEAs  expected  more  detailed  packages*    Therefore*  awsreness  materials 
that  made  the  exact  nature  and  limitations  of  the  PIPs  clear  were  needed* 
Panel  members  also  stated  that  specific  curricula  was  not  a  realistic  goal 
for  the  PIPs  since  each  LEA  develops  its  own  curriculum  And  any  bilingual 
education  plans  would  have  to  be  coordi^^ated  with  local  objectives* 

The  dissemination  of  PIPs  by  the  TRCs  would  have  profited  from  in- 
creaaed  technical  assistance  from  OBE*  as  well  as  specific  allocations  of 
time  and  money  for  this  purpose*    TRCs  reacted  differently  to  OBE  instruc** 
tions  because  each  TRC  made  slightly  different  interpretations  of  the  OBE 
instructions*  served  different  populations*  and  had  different  priorities* 
Some  panel  mmbers  suggested  other  organizations  or  inetitutions  should 
have  been  involved*  and  all  agreed  that  the  dissemination  effort  should  be 
redesigned  * 


Table  B-2 


Panel  Suggestions  for  PIP  Rcvlslori 


•  PIPs  ahould  be  non-» language  specific*    Certain  sections  of  a  PIP 
could  be  targeted  for  a  specific  language  such  as  Spanish  or  a  spe- 
cific population  group  such  as  Native  Atnerlcan* 

•  PlPa  should  offer  collections  of  alternatives  so  that  LEAs  can  select 
locally  appropriate  or  desirable  features* 

•  PIPs  should  detail  legal  requirements  of  bilingual  education  programs* 

•  PlPa  should  be  combined*    The  three  Spanish/English  PIPs  could  be 
merged  I  or  all  four  PIPs  could  be  combined  since  the  French/English 
PIP  la  not  substantially  different*    Needed  addltlona  could  also  be 
made* 

•  PIPs  ahould  reflect  a  variety  of  contexts*    Different  strategies 
should  be  provided  for  populatlona  with  different  language  charac- 
teristics*   Strateglea  should  be  offered  for  working  under  lesa  than 
Ideal  conditions — such  as  a  ahortage  of  bilingual  teachera* 

•  PIPs  should  be  resources  that  Include  Information  on  teacher  trainings 
sources  of  curriculum^  abatracts  of  relevant  research »  and  Information 
on  testing*    The  PIP  could  be  a  link  to  important  resources* 

•  PIPs  should  be  a  serlea  of  pamphlets  on  asaessment  and  management* 

•  PIP  staff  development  sections  should  reflect  the  phlloaophy  that 
staff  training  la  more  effective  when  occurs  on  alte  taking  into 
account  local  conatralnts^  rather  than  In  an  Idealized  setting* 
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Panel  members  reported  that  LEAs  decided  to  adopt  PIPs  for  many 
reasons  other  than  the  desire  to  Implement  a  model  program*    LEAs  were 
motivated  by  the  need  to  comply  with  state  or  federal  regulations »  the 
promise  of  TRC  help,  or  the  enhanced  prospects  of  funding*    In  addition, 
LEAs  had  different  perceptions  of  what  it  meant  to  adopt  and  replicate  a 
program*    All  of  these  contextual  realities  should  be  taken  into  consid* 
era t ion  ^.n  future  dissemination  efforts* 

Student  Ouccome  Evaluation 

Student  outcome  evaluation  refers  to  an  assessment  of  project  Impact 
on  student  achievement  and  attitudes* 

RMC  Study  Questions  Addressed 

What  are  the  effects  of  the  adopter-site  projects  on  the  students? 

1*    What  were  the  effects  on  first  and  second  language  skills? 

2*    What  were  the  effects  in  other  subject  areas? 

3*    What  were  the  effects  on  attitudes  sxtd  self -concepts? 

RMC  Study  Findings 

Since  RHC  planned  to  report  outcome  evaluation  dats  only  for  the  sec^ 
ond  year  of  the  study,  findings  in  this  section  referred  to  the  work  done 
by  RHC  and  site  evaluators  in  planning  and  Implementing  evaluations* 

Technical  assistance  was  offered  to  all  sites  in  completing  the  fol- 
lowing minimal  reqairments  essential  to  an  interprettible  evaluation: 
(1)  describing  the  students,  (2)  providing  reaningful  comparison  groups, 
(3)  using  technically  adequate  tLsts,  (4)  matching  tests  to  curriculum, 
and  (5)  using  adequate  testing  dates  and  scoring  procedures*  However 
nearly  all  sites  had  difficulties  with  certain  requirements,  such  as 
providing  a  comparison  group* 


389 


There  were  several  evaluation  problems  connected  with  this  study 
which  appeared  to  have  no  immediate  technical  solutions*    Only  results  for 
kindergarten^  firsts  and  second  grades  were  available^  even  though  the 
projects  will  eventually  expand  to  third  and  fourth  grade  where  it  may  be 
more  reasonable  to  expect  visible  results*    Then  too»  there  were  more 
problems  of  reliability  and  validity  with  tests  given  at  the  lower  ele- 
mentary level*    In  addition^  because  of  the  one-year-at-a-time  upward 
expsnsion^  the  second  grade  results  reported  actually  represented  the 
first  year  of  implementation  for  that  grade*    in  many  projects »  goals  were 
not  ststed  in  measurable  terms  snd  were  often  unrealistic*    The  adopter 
LEAs  varied  in  their  prior  experience  with  bilingual  education  and  with 
their  level  of  implementation*    Identifying  project  effect^  rd^^idly  becaioe 
a  very  complex  task* 

KMC  Recommendationa 

The  19  sites  displayed  m&*v  differences;  therefore »  data  should  not 
be  aggregated  across  sites*    The  variance  between  sites  should  be  a  topic 
of  investigation^  including  the  spparent  sources  of  vsriance  atid  the 
magnitude  of  variance*    A  case  study  approach  seemed  the  most  sppropriate 
way  to  organize  this  analysis*    Because  many  sites  had  small  numbers  of 
students^  and  because  there  were  many  confounding  varisbles^  there  were 
not  enough  degrees  of  freedom  to  exsmine  variables  statistically* 

Panel  Recommendations 

Panel  members  msde  the  following  suggestions:    (1)  do  not  report 
measurement  of  areas  that  are  not  intended  project  outcomes »  (2)  describe 
conditions  necessary  for  an  adequate  evaluations  (3)  compare  outcomes  of 
students  involved  in  the  progrsm  for  vsrying  lengths  of  time^  and  (4) 
measure  sll  intended  project  oi^tcomes* 

A  number  of  comments  weri>  made  in  the  area  of  language  proficiency 
testing*    Instruments  should       "ttased  on  second  language  research*  Scores 
should  be  interpreted  critically  becsuse  the  same  scores  in  first  snd 
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second  language  may  call  for  different  Interpretations*    Ideally,  testing 
for  production  should  be  done  individually  but»  if  this  is  not  poddible» 
listening  comprehension  tests  that  correlate  highly  with  production  can  be 
substituted*    Syntax  is  the  best  area  of  language  proficiency  to  test* 

Other  ideas  for  evaluation  that  were  presented  were  beyond  the  scope  of 
the  present  study  but  are  worth  considering  for  future  evaluation  studies* 
Suggestions  included  identifying  minimal  featured  for  an  effective  program^ 
identifying  "high  success"  and  "low  success"  projects  and  analyzing  them» 
and  linking  features  of  treatment  to  outcome* 

Another  area  that  RMC  did  not  examine^  but  that  is  potentially  very 
interesting^  is  the  effect  of  the  program  on  the  cultural  world  of  the 
child*    Data  could  be  gathered  on  native  language  achievement*  degree  of 
aosimllation  and  deculturation*  retention  of  family  and  community  vaxues» 
communication  between  parent  snd  child»  and  affective  growth*  Finally^ 
an  analysis  could  be  made  of  the  relationship  between  academic  growth  snd 
socio«cultural  effects* 
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APF&NDIX  C 

A  DETAILED  SDHHABY  AND  COHPARISOH  OF  FIF  CONTENTS 


Summary  of  the  Contents  of  the  Four  BlllriRual  PIPs 


The  history  of  the  development  of  the  four  bilingual  PIPs  is  dis^ 
cussed  in  the  Introduction  section  of  this  volume*    This  appendix  sum* 
narizes  the  content  of  the  PIPs  by  comparing  the  four  projects  systesat* 
ically  to  a  model  for  bilingual  project  description*    The  forioat  and 
organization  of  the  PIPs  and  the  model  against  which  they  were  compared 
are  described  briefly  below* 

Format  of  the  PIPs*    A  PIP  is  a  set  of  manuals  containing  Instructions 
for  implementing  a  project  in  a  school  district*    Each  nanual  is  designed 
for  a  key .v>roject  staff  person  or  for  a  particular  project  function*  Theo** 
retically»  the  PIP  manuals  provide  a  comprehensive »  detailed  description  of 
a  model  project  so  that  a  school  district  can  Implement  the  same  project 
without  further  technical  assistance*    A  list  of  the  manuals  and  material 
found  in  each  PIP  appears  in  Table  C*l*    The  manuals »  with  some  exceptions » 
were  originally  contained  in  a  plastic  box»  reinforcing  the  idea  o£  a  uni* 
fled  package*    Tba  Project  Orientation  Materials  were  disseminated  sepa* 
rately  and  the  Site  D€\^eloped  Materials  were  too  bulky  to  fit  in  the  box* 

The  tables  of  contents  from  the  Nuevos  Horizontes*PIP  manuals  are 
reproduced  by  way  of  example  in  Table  C**2*    As  can  be  seen  in  the  table» 
certain  chapters  are  repeated  in  several  manuals*    The  Project  Management 
Directory  (PMD)  is  the  manual  intended  for  the  project  director*  and  it 
is  the  lengthiest  manual  since  much  of  the  information  included  in  other 
staff  members^  manusls  also  appears  in  the  PMD*    How€irer»  the  packagers 
intended  the  project  director  to  have  a  complete  set  of  manuals*  since 
the  PMD  is  not  a  summary  of  the  other  manuals* 
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Table  C-1 


Hanuals  Included  In  the  Vlfa 


A 
A 

nn 

V 

Prolect  Management  Directory 

X 

X 

X 

X 

Froiect  Orientation  Materials 

X 

X 

X 

X 

Froiect  Kanaeentent  Calendar 

X 

X 

X 

X 

Teacher's  Manual 

X 

X 

X 

X 

Site  Developed  Materials 

X 

X 

X 

Evaluator's  Manual 

X 

X 

X 

X 

Staff  Development  Manual 

X 

Instructional  Consultant's  Manual 

X 

Instructional  Consult ant /staff  Development 
Manual 

X 

Instructional  Coordinator's/Staff  Development 
Manual 

X 

Manual  for  the  Use  of  Performance  OMectives 

X 

X 

X 

Community  Coordinator's  Manual 

X 

French  Specialist's  Manual 

X 

Enf^lish  Curriculum  Coordinator's  Manual 

X 

A  Adelante 
NH        Nuevos  Horizontes 

S  "  Savoir 

V  "  Venceremos 
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Table  C-2 

Sample  table  of  Contenta  of  a  Set  of  pip  Manuala 


PROJECT  HANAG^fENT  DXRBCTORT 
TABLE  OF  CONTEKTS 


Preface 

iv 

'oter 

l: 

Project  Overvieu  1 

Cidpter 

2: 

Ualng  the  plp  13 

Chapter 

3: 

Management  Approach  21 

Chapter 

4: 

Communicating  with  School  and  Community 

Chapter 

5: 

Continuing  Beyond  the  ?irat  Year  69 

Chapter 

6: 

Budget  75 

Chapter 

7: 

beXecting  stuaenta  7^ 

Chapter 

8: 

Claaaroom  Implementation  97 

Chapter 

9: 

Selecting  Staff  115 

Chapter 

10; 

Staff  Development  125 

Chapter 

11; 

Staff  Eelationahipa  145 

Chapter 

12: 

Materiala/Equipment/Suppliea/teata  153 

Chapter 

13: 

Aicilities  177 

Chapter 

14: 

Goals  181 

Chapter 

15: 

Taak  Checklista  187 

Index  192 
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Table  C-2  (Continued) 
Sample  Table  of  Contents  of  a  Set  of  PIP  Manuals 


INSTRUCTIONAL  COORDINATOR'S/STAFF  DEVELOPMENT  MANUAL 

TABLE  OF 

CONTENTS 

Preface 

iv 

Introduction 

vi 

Chapter 

I: 

Project  Overview  I 

Chapter 

2: 

The  Instructional  Coordinator  13 

Chapter 

3: 

Instructional  Support  21 

Chapter 

4: 

Materials /Equipment  Development  &  Selection  33 

Chapter 

5: 

Staff  Development  Overview  63 

Chapter 

6: 

The  Start-up  Workshop  71 

Chapter 

7! 

In**service  Workshops  79 

Chapter 

8: 

Other  Staff  Development  Activities  85 
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Table  0>2  (Continued) 
Sais^le  Table  of  Contents  of  a  Set  of  PIP  Manuals 


TEACHER^S  MANUAL 
TABLE  OF  CONTENTS 
Preface  iv 
Introduction  vi 

Chapter    I:    Project  Overview  I 
Chapter    2:    Roles  and  Relationships  13 

Chapteif    3:    Laying  the  Groundwork  for  Classroom  Implementation  21 

Chapter    4:    Getting  Started  73 

Chapter    5:    Classroom  Implementation  83 


1 
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Table  C*2  (Continued) 
Sample  Table  of  Contents  of  a  Set  of  pip  Manuals 


KANDAL  FOR  THE  USE  OF  PBRFORMAKCE  OBJECTIVES 

TABLE  OF  CONTENTS 

INTRODUCTION  Iv 

Second  Grade  h7 

Language  Ability  47 

USING  THE  MANUAL  1 

Reading  48 

Spelling  49 

PERFORMANCE  OBJECTIVES: 

Mathematics  50 

PROJECT  OUTCOMES  AND  PROCEDURES  2 

Science  53 

Social  Studies  54 

Goala  2 

Kindergarten  8 

Third  Grade  56 

First  Grade  12 

Langusge  Ability  56 

Second  Grade  16 

Reading  57 

inirQ  «r«ae  zu 

opexx*ng  jo 

Fourth  Grade  25 

Mathematics  59 

Science  62 

STUDENT  SKILLS  30 

Social  Studies  63 

Overview  30 

Fourth  Grade  64 

Language  Ability  64 

Kindergarten  32 

Reading  65 

Language  Ability  32 

Spelling  66 

Following  Directions  34 

Mathematics  67 

Reading  Readiness  34 

Science  70 

Phonics  35 

Social  Studies  71 

Mathematics  35 

Science  36 

Social  Studies  38 

First  Grade  39 

Language  Ability  39 

Reading  39 

Spellii^  41 

Mathematics  41 

Science  45 

Social  Studies  46 
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Table  C*2  (Continued) 
Sample  Table  of  Contents  of  a  Set  of  PIP  Manuals 


COHHUNITY  COQBDINAIOR'S  HAHOiO. 

TABLE  OF  CONTENTS 

Preface  Iv 

Introduction  vl 

Chapter  1:    Project  Overview  1 

Chapter  2:    Koles  and  Relationships  13 

Chapter  3:    Parent  and  Community  Involvement  20 
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Table  C*2  (Continued) 
Sample  Table  of  Contents  of  a  Set  of  PIP  Manuals 


EVALUATOR'S  MANUAL 

TABLE  OF  CONTENTS 

Preface  Iv 

Introduction  vi 

Chapter  1:    Project  Overview  1 

Chapter  2:    Strategies  for  Planning  and  Accomplishing 
Project  Evalu^ition  21 

Chapter  3;    The  Evaluator's  Role  43 

References  46 
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Model  for  bilingual  project  description.    The  Model  for  Bilingual 
Project  Description  appears  In  full  following  this  Introduction  and  serves 
aa  a  table  of  contents  for  the  summary  of  the  PIPs*    The  purpose  of  using 
a  model  was  cwo-rold.    Flrst»  it  w^s  desirable  to  use  a  system  other  than 
the  PIP  organization  which  Is  Intentionally  repetitive.    Second^  In  com*" 
paring  the  PIPs  to  a  very  comprehensive  description^  areas  covered  by  the 
PIPs  as  well  as  areas  not  addressed  by  the  PIPs  could  be  discussed  sys*" 
tematlcally. 

The  Model  for  Bilingual  Project  Description  waa  developed  over  the 
two  years  of  the  study.    The  model  was  developed  baaed  on  staff  expertlae 
and  the  experience  of  the  bilingual  PIP  field  test.    Literature  from  the 
field  of  bilingual  education  was  also  examined*  Including  similar  models 
that  h"ve  bean  developed  (Hackey»  1977)  and  a  wide  variety  of  more  general 
current  works  (see»  for  example^  Center  for  Applied  Llngulatlcs»  1S77» 
1978).    The  model  Is  divided  Into  three  areas:    (1)  summary  and  context; 
(2)  Instruction;  and  (3)  management.    Each  area  lists  categories  to  be 
considered  In  providing  a  comprehensive  project  description.    Though  it 
Is  always  somewhat  artificial  to  divide  an  organic  whole  like  a  project 
Into  a  system  of  categorlea^  to  the  extent  possible^  the  model  Is  Intended 
to  be  systematic  and  comprehensive. 

The  organizing  headings  for  the  PIP  descriptions  are  the  same  as  the 
model  categories.    Each  major  subheading  Is  followed  by  a  "Discussion*' 
section  which  frequently  Includes  one  or  more  tables  summarizing  the  con*- 
tent  of  the  four  PIPs.    The  corresponding  table  numbers  appear  In  parent 
thesis  by  the  relevant  discussion  heading.    After  each  discussion*  the 
"Usefulness  to  adopte*.s"  section  considers  the  practical  application  of 
the  PIP  Information  taking  Into  account  the  experience  of  the  field  t<ist. 
The  "Conclusion"  sections*  at  the  end  of  each  group  of  related  headings* 
make  more  general  anJ  s'lmmari  Ing  statements*    The  model  which  sppears  In 
full  also  server  as  a  f   tailed  edible  of  contents. 
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MODEL  FOR  BILINGUAL  PROJECT  DESCRIPTION 
AND 

DETAILED  TABLE  OF  CONTENTS 


Pafie 


1.    OVERVIEW  OF  THE  FOUR  BILINGUAL  PIP  PROJECTS 

1.1  Prolect  Summary 

1.1.1  Major  Goals   C-17 

1.1.2  Target  Student  Population   C-IS 

•  Language  characteristics 

•  Achievement  levels 

1.1.3  Grades  and  Number  of  Classrooms  Served    C^19 

1.1.4  Portion  of  School  Day  Covered   C-19 

1.1.5  Conclusions     C-2(} 

1.2  Local  Context 

1.2.1  Community  Characteristics   C~20 

•  Languages 

•  Ethnicity 

•  SES 

•  Mobility 

•  Size 

1.2.2  LEA  Description   C-21 

•  Si£:e 

•  Financial  status  of  district 

•  Facilities  available  for  project 

1.2.3  Relevant  History  of  LEA  and  Community   C-22 

•  Special  projects 

•  Desegregation 


1.2.4  Instructions  for  Adapting  to  Local  Conditions.  .  .  C-22 

•  Adopting  a  model  project 

•  Adopting  "standard"  bilingual  education 

procedures 

1.2.5  Cone  lusions   C-25 
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2.    IKSTRUCTIONAL  APPROACH 

2.1  Content  of  Instruction 

2.1.1  Content  Areas  Covered   C-26 

2.1.2  Vhat  Determines  Content   0^27 

2.1.3  Other  Content  Features    C*28 

#  Relationship  of  content  to  goals 

#  Articulation  of  project  content  with  existing 
district  curriculum 

2.1.4  Conclusions  «  ^   C-29 

2.2  Presentation  of  Content 

2.2.1  Instructional  Models  or  Theories    C»30 

#  Bilingual  education  model 

#  Other  model 

2.2.2  Methodologies  for  Bilingual  Education   C-31 


#  Language  of  Instruction 

—  general  language  use  plan  for  teacher  and 
student  over  length  of  project 

~  dally  Instructional  time  In  each  language 
~  variations  for  different  student  groups 
~  criteria  for  eatabllshlng  language  of 
Instruction 

#  Approach  to  non-standard  forms 

—  acceptance 

—  form  of  corrections 

#  Approach  to  second  language  Instruction 

—  formal  Instruction 

~  second  language  use  for  Instruction  and 
other  activities 

#  Approach  to  reading  Instruction 

—  language  In  which  students  learn  to  read 

—  criteria  for  beginning  reading  In  second 
language 

2.2.3    Specific  Methodologies  for  Each  Subject  Area      •  •  C^35 
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Rate  

•  Variation  in  pace  of  instruction  for  indi- 
viduals or  groups 

•  Time  on  task 

~  minutes  per  day  per  content  area  (see 
schedule) 

—  proportion  of  time  student  is  actively 
engaged  in  prodi'cing  responses  for  which 
she/he  gets  feedback 

Self-Concept  Development  and  Motivation  (Aspects 
of  program  that  may  motivate  students  and  improve 
their  self-concept)  

•  Appropriate  content  and  language  of  instruction 

—  using       for  instruction 

—  accepting  the  language  of  the  chiH 

—  content  that  relates  to  experience  of 
children 

—  culturally  rclevanL  material 

•  Improved  affective  climate 

~  placing  equal  value  on  both  languages  and 

cultures 
~  insuring  student  success 

—  involvinis  parents 

~  teacher  as  a  role  model 

•  Discipline  approach 

—  philosophy 

~  guidelines/control  over  approach 

•  Special  reward  systems 

—  prizes*  privileges 

Materials  

•  Core  materials  in  use 

—  commercial 

—  locally  developed 
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•  Appropriateness 

—  linguistic 

—  cultural 

2.2.7  Personnel  Roles  In  Classroom    C-45 

•  Teachers 

•  Aides 

•  Parents 

•  Peers 

•  Resource  staff 

2.2.8  Conclusions   C*48 

2.3  Student  Selection 

2.3.1  Entry  Criteria  and  Procedures   c-4d 

2.3.2  Exit  Criteria  and  Procedures   C-49 

2.3.3  Conclusions   &-49 

2.4  Scheduling 

2.4*1    Grouping  and  Regrouping   C-51 

•  Across  classes 

•  Within  classes 

2.4.?    Dally  Schedules   C~53 

2.4.3    Conclusions   C~5  3 


3.  MANAGEMENT 

3.1  Staff  Organization 

3.K1    List  of  Staff  Members  and  Time  Commitment   C*55 

3.1.2  Organizational  Structure    C~55 

3.1.3  Qualifications   C-57 

3.1.4  Selection  Procedures    C-57 

3.1.5  Conclusions   C~59 

3.2  Staff  Roles  (describe  responsibilities) 

3.2.1    Project  Director    C-60 


•  Style  of  leadership  as  determined  by  project 
and  LEA 

•  Fun'^s  and  budgets 

•  Public  relatl>>iis 
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Page 

•  Administration 

•  Overseeing  instruction 

•  Staff  training 

•  Developing  and  ordering  materials  and  equip- 


ment 

•  Staff  recruiting  and  hiring 

3.2.2    Teachers   C-64 

•  Plfinning  instruction 

•  Implementing  instruction 

•  Hon-instructional  responsibilities 

3*2.3    Aides   C-64 

3.2.4  Other  Staff   C-66 

•  Instructional  coordinator 

•  Community  coordinator 

•  Evaluator 

3.2.5  Conclusions   C*66 

3.3    Staff  Development 

3.3.1  Reeds  Assessment    C-68 

3.3.2  Structure  of  Training   C-68 

•  Pre-service 

•  In-service 

3.3.3  Characteristics  of  Training   c-68 


•    Appropriateness  for  staff  of  differing  levels 


of  knowledge  and  experience 

•  Practicality 

•  Coordination  with  degree  programs 

•  Integration  with  other  training 

3.3.4  Audiences  Trained   C-70 

•  Project  staff  included 

•  Inclusion  of  non*project  staff 

3.3.5  Conclusions   C-70 

3.4    Parent  and  Community 

3.4.1  Parent  Involvement  in  School  Affairs   C*72 

3.4.2  Community  Input  in  Program  Flanniiig   C^74 

•  Advisory  group 
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3*4*3    Community  Support  for  Project  « 

3*4*4    Parent  Education   

3*4*5    Parent  Conferences /Counseling  

3*4  * 6  Conclusions  

Communication 

3*5*1    Staff  Relations  

3*5*2   Relations  with  Non*ProJect  Staff   

4r   District  administrators 

•  Principals 

•  Non-project  teachers 

•  School  board 

3*5*3    Dissemination  of  Project  Xnfoinnation  

•  School  personnel 

•  Parents  and  community 

3*5*4  Conclusions  

Evaluation 

3*6*1    Strategies  for  planning  and  implementing  project 

evaluation   

3*6*2  Conclusions  
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K    OVERVIEW  OF  THE  FOUR  BILINGUAL  pip  PROJECTS 
Kl    Summary  of  Projects 

Goals  (Table  C-3) 

Dl s CUBS Ion ^    The  stated  goals  In  the  pips  Indicate  a  large  degree  of 
similarity  among  the  four  bilingual  projects^    Bow€\^er,  there  Is  «ven  more 
similarity  among  the  Implicit  goals  of  the  projects  which  are  also  Included 
In  summary  form  In  Table  0-3^ 


Table  C-3 
Project  Goals 


Stated  Goal 

Implicit  Goal 

Goals 

A 

S 

V 

A    im  s  V 

Success  In  functioning  In  an 
English-speaking  society 

X 

XXX 

xmptu ve  cicnxeveiiient  xn  Qcaaemic 
subjects 

X 

X 

X 

X 

Develop  a  positive  self^concept 

X 

X 

X 

X 

Knowledge  of/prlde  In  own/US  culture 

X 

XXX 

Involve  parents »  community 

X 

X 

X 

X 

Staff  development 

X 

X  XX 

Children  need  not  learn  English  at 
expense  of  academic  development 

X 

XXX 

Develop  listening  and  speaking  skills 
In  both  English  and  native  language 

X 

X 

X 

X 

Develop  reading  and  writing  ekllle 
In  both  English  and  native  language 

X 

X 

X 

Develop  reading  and  writing 
skills  first  In  English 

X 

Equal  Instructional  time  In  both 
languages 

X 

X 

X 

A   "   Adelante;  NH  "   Nuevoe  Borlzontee;  S 

m 

S avoir; 

V 

~  VenceremoB 
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Usefulness  to  adopters*    The  goals  provided  In  the  PIPs  represent  a 
fairly  comprehensive  list  of  commonly-^used  goals  for  bilingual  education 
programs*    They  are  not  innovative  but  they  are  of  some  use  to  inexperi- 
enced project  directors  in  program  planning*    Many  goals  are  overly  gen* 
eral  and  need  to  be  expanded  and  clarified*    For  example,  it  is  not  clear 
whether  the  goal  of  equal  time  devoted  to  each  language  refers  to  instruc- 
tional time  only,  or  to  student  language  use,  or  to  some  other  factor*  It 
could  mean  each  subject  should  be  divided  between  both  languages  or  that 
the  day  as  a  whole  should  be  divided* 

1*1*2    Target  Population  (Table  C-4) 

Discussion*  The  four  projects  are  primarily  designed  for  students  of 
limited  English  speaking  ability,  but  the  student  language  characteristics 
were  slightly  different  for  each  PIP-project  originating  site*  These  dif- 
ferences are  reflected  in  the  PIP-specif ied  target  populations  summarized 
in  Table  C-4*  The  Huevos  Horizontes  PIP  also  mentions  selecting  under- 
achieving students,  and  the  other  three  PIPs  state  that  the  funding  agency 
may  define  the  target  population* 


Table  C-4 
PIP-Specif ied  Target  Populations 


Adelan te 

Huevos 
Horizontes 

Savoir 

Venceremos 

Mainly 
Spanish 
dominant,  but 
can  absorb  a 
few  bilingual 
and  English- 
dominant 
students 

Spanish 
dominant, 
bilingual, 
and  English 
dominant 
students 

Students  with 
background 

in  both 
French  and 
English 

Spanish** 
dominant 
students 

Usefulness  to  adopters*  The  definitions  of  populations  to  be  served 
by  each  PIP  project  are  somewhat  misleading*  Each  PIP  describes  projects 
that  are  generally  appropriate  for  that  population,  but  few  population- 
specific  plans  are  provided.  For  example,  while  Huevos  Horizontes  is  de-^ 
scribed  as  a  project  for  monolingual  Spanish,  monolingual  English  and  bi- 
lingual students,  the  instructional  plan  does  not  explain  how  to  organize 
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a  classroom  with  three  distinct  linguistic  populations.  In  fact»  many  of 
the  instructional  practices  are  similar  across  the  four  projects. 

1-1.3    Grades  and  ff^imher  of  Classrooms  Served    (Table  C-5) 

Discussion.    All  the  projects  as  described  in  the  PIPs  begin  with 
kindergarten  and  first  grade  classrooms  and  expand  vertically  one  grade 
per  year  until  fourth  grade.    (Th«  projects  did  not  evolve  in  this  way  in 
all  the  developer  sites.)    The  Intended  slzea  of  each  project  vary  some^ 
what  based  on        size  of  the  origination  site.    The  suggested  numbers  of 
students  and  teachers  are  summarized  in  Table  C~5. 


Table  C-5 

Number  of  Claasrooms  and  Number  of  Students 


Teachers 

Proj  ect 
Year 

Adelante 

Huevos 
Horlzontes 

Savolr 

Venceremos 

1 

12 

16 

16 

6-8 

Teachers 
CK-4> 

4 

30 

40 

32 

16-20 

StudsnCs 
(K-n 

1 

300 

400 

400 

100 

Students 
(K-4) 

4 

750 

1.000 

800 

500 

1.1.4    Portion  of  School  Day  Covered 

Discussion.    The  projects  cover  all  or  a  major  portion  of  the  school 

day. 

Usefulness  to  adopters.    The  one*grade"per-year  upward  expansion  de- 
sign of  the  PIPs  does  not  reflect  what  occurred  at  the  origination  sites* 
This  model,  however,  may  be  helpful  to  districts  inexperienced  with  bilin- 
gual education  programs.    Field  experience  showed  thac  adopter  sites  re- 
sponded to  local  conditions  and  not  to  PIP  directives  in  selecting  the 
size  of  their  project.    The  projects  are  intended  to  cover  the  entire 
school  day  since »  at  the  elementary  level,  most  students  are  in  self- 
contained  classes.    However,  the  PIPs  do  not  address  themselves  to  the 
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project  students'  participation  in  other  special  programs  or  in  general 
school  activities »  an  area  of  coordination  that  was  necessary  at  many 
adopter  sites* 

1*1*5    Conclusions  (Project  Summary) 

The  goals  of  the  bilingual  PIPs  are  similar  to  the  goals  of  bilingual 
education  in  general*    The  projects  do  not  differ  significantly  from  each 
other  or  from  general  practices  common  to  many  bilingual  projects*  The 
goals  provide  a  starting  point  for  a  district  planning  its  first  bilingual 
project)  but  it  is  misleading  to  think  of  the  four  PIPs  as  offering  four 
distinct  approaches*    Differences  vhich  seem  critical  at  first  glance» 
such  as  the  student  population  served »  lose  their  meaning  because  there 
are  no  corresponding  differences  in  classroom  management  and  instructional 
techniques*    The  student  population  labels  described  in  each  PIP  reflect 
the  population  at  the  originating  site  and  do  not  mean  that  the  project 
is  appropriate  only  to  that  group* 

1*2    LEA  Context 

1*2*1    Community  Characteristics 

Discussion  *    Each  PIP  describes  briefly  the  context  of  the  project 
on  vhlch  it  is  baaed*    The  stadiant  population  at  thre'^  of  the  orginating 
sites  is  reported  to  have  lov  test  scores*    The  majority  of  the  54%  Span^ 
ish  surnamod  student  population  at  th«£  fourth  site  vere  described  as  na- 
tive Spanish  speakers*    A  high  drop-out  rate  vas  a  demographic  feature  at 
one  sitti»  aud  Icj  SES  and  high  mobility  vere  mentioned  as  significant  in 
another*    It  seems  likely»  hovever»  that  all  of  these  characteristics  vere 
present  in  aome  degree  at  all  four  originating  sites*    Two  of  the  projects 
originated  in  rural  settings,  while  the  remaining  two  were  developed  in 
urban  areas* 

The  Project  Selection  6uid^  does  not  suggest  that  community  charac- 
teristics of  an  adopting  LEA  should  match  the  context  description  of  the 
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originating  aite  in  any  way  except  in  the  language  characteristics  of  the 
students*  which  are  described  in  the  previous  section* 


Usefulness  to  adopters*    Since  community  characteristics  of  adopted 
sites  need  not  match  those  of  the  origination  site  their  inclusion  is  not 
helpful  and  may  even  be  counterproductive*    ?ield  experience  showed  that 
urban  sites  were  unwilling  to  adopt  projects  developed  in  rural  areas»  for 
example*  even  though  there  inay  have  been  no  programmatic  reasons  for  ex- 
cluding such  projects* 

1*2*2    LEA  Description 

Discussion*    Each  PIP  requires  different  numbers  of  schools  and 
teachers*  which  implicitly  suggests  that  larger  districts  should  adopt 
the  larger  projects  (see  Table  C*5)*    However,  district  size  is  not  spe- 
cifically discussed*    The  ASKs  have  a  brief  section  entitled  Capability 
in  which  districts  are  cautioned  to  adopt  a  particular  PIP  only  if  cer* 
tain  staffing,  schedulingt  and  space  requirements  can  be  met*  District 
finances  are  not  discussed  in  the  capability  section,  but  each  piP  iih* 
eludes  a  set  of  budget  sheets  from  which  project  costs  can  be  calculated* 

The  three  Spanish/English  PIFs  require  project  classrooms  to  be  near 
one  another  and  administrative  offices  in  the  district  administration 
building*    The  French /English  PIP  requires  classrooms  to  be  available, 
and  administrative  offices  to  be  near  one  another*    Adelantet  in  addition, 
requires  office  space  for  the  instructional  consultant  in  the  schools* 
The  project  director  is  charged,  in  all  cases,  with  making  the  required 
arrangements* 

Osefulnesa  to  adopters*    Basic  information  about  facilities  and  num- 
ber of  classrooms  required  is  undoubtedly  helpful  to  project  planning, 
although  most  sites  make  their  decisions  on  the  basis  of  local  considera*- 
tions  * 
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i.2.3    Relevant  History 


Discussion.    There  Is  no  discussion  In  the  PIPs  about  coordination 
of  the  bilingual  projects  with  existing  special  projects  that  may  be 
serving  the  same  population.    The  desegregation  Issue,  which  Is  of  prime 
concern  to  school  districts  and  may  also  affect  the  same  students,  Is  also 
not  discussed. 

Usefulness  to  adopters.    Field  experience  showed  the  need  to  include 
Information  on  coordination  with  other  projects  and  on  OCR  regulations. 

i.2.A    Adapting  to  Local  Conditions  (Table  C-6) 

Discussion.    Adapting  to  local  conditions  Is  discussed  briefly  in 
relation  to  the  general  use  of  the  PIP,  and  more  specifically  In  connec- 
tion with  staff  selection  and  with  budget.    The  brief  general  comments, 
which  are  Identical  In  all  four  PIPs,  state  that  the  adopters  should  be 
In  agreement  with  the  developers  on  ^'fundamental  philosophy  and  goals" 
although  "strategies  and  workable  solutions. • .will  differ  from  site  to 
site.** 

In  the  staff  selection  chapter,  a  list  of  skills  and  talents  Is  of- 
fered for  consideration  In  hiring  a  well  rounded  staff.    The  list,  which 
Is  Identical  In  three  PIPs,  Includes  such  skills  as  report  writing,  mate- 
rials development,  the  ability  to  write  objectives  and  develop  criterion- 
referenced  tests,  and  sensitivity  to  the  needs  of  all  participants.  The 
extent  to  which  project  size  can  be  adapted  Is  discussed  in  each  PIP  in 
the  budget  chapter  and  Is  summarized  here  In  Table  C-6. 

Ko  suggestions  are  provided  for  adapting  to  other  conditions,  such  as 
high  student  mobility,  lack  of  bilingual  teachers,  or  st^idents  who  differ 
significantly  from  those  at  the  origination  site. 
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Table  C-6 


Adaptation  of  Project  Size 


Adelante 

NueVos 
Horizon tes 

Savoir 

Venceremos 

I-  Increased  Population 

Beginning  and  final  student 
Population  suftReeted  bv  PIP 

30c 
700 

400 
1*000 

400 
800 

100 
500 

Extent  te  which  population 
can  be  incrt^ased 

Can  add  500 
students 

Possible  1  no 
specified  number 

Can  add  100 
students 

Unspecified 

Additional  support  staff 
needed 

Add  a  third 
instructional 
consultant 

One  instruc- 
tional coordina-* 
tor  for  every 
400  students 

None 

Add  one  instruc- 
tional consul- 
tant; increase 
evjkluator  from 
half  to  full- 
time 

II*  Decreased  Population 

Extent  to  which  population 
can  be  decreased 

150-375  given 
as  at  example 

Possible 1  no 
specified  number 

400  maximum 
is  given  as 
an  example 

60-300  given 
as  an  example 

Suggested  staff  changes 

Staff  cannot  be 
combineut  but  if 
ataff  already 
exist  in  other 
positions  I  they 
may  perform  cur*- 
lent  functiors 
and  Venceremos 
1  functions 

None  suggested 

Combine  English 
curriculum  co** 
ordinator  and 
French  special- 
ist; share 
aides 

Same  aa 
Adelante 

Table  C-6  (Continued) 


Adelante 

Nuevos 
Horizon tes 

Savoir 

Venceremos 

II*  (Continued) 

PIP  states  project  will  not 
be  cost  effective  if  stu-- 
dent  population  is  signif- 
icantly reduced 

X 

X 

X 

III  •  General  recoiumendation  on 
changing  project  size 

UK  to  add  up  to 
500  students 

May  he  altered 
but  Implica- 
tions on  cost, 
staffiDg,  etc* 
must  be  con- 
sidered 

UK  to  add  lUO 
students*  Proj- 
ect is  based  on 
close  communi- 
cation 

Ex  t  rente  exp£t  n*^ 
£jion  not  recom- 
mended; small 
size  is  a  fac~ 
tor  in  effec- 
tiveness 

Usefulness  to  adopters.    Adapting  to  local  conditions  is  potentially 
a  Very  important  step  in  Implementing  a  project  from  another  location. 
All  of  the  PIPs  acknowledge  the  need  to  adapt.    The  section  in  all  the  PIPs 
on  hiring  a  balanced  staff  even  if  each  staff  member  does  not  have  all  the 
desirable  qualifications  ia  Very  useful  in  implementing  a  project  in  any-* 
thing  other  than  ideal  circumstances.    Information  on  adaptation  of  proj- 
ect sise  is  important  because  it  is  unlikely  that  the  numbers  of  students 
suggested  in  the  PIP  are  going  to  coincide  exactly  with  district  needs. 
While  all  of  the  PIPs  allow  some  flexibility  in  project  sise*  their  direc- 
tivea  are  not  consistent.    For  example*  why  can  Adelante  add  500  students 
and  Savoir  only  100?    However,  field  text  experience  showed  that  districts 
adapted  the  projects  to  suit  local  sise  requirements,  and  the  PIP  direc*" 
tives  had  limited  Influence  in  this  area. 

1.2.5    Conclusions  (LEA  Context) 

It  is  difficult  to  determine  what  contextual  information  is  necessary 
to  describe  a  successful  project  for  replication.    Certain  kinds  of  infor-* 
mation  may  constrain  adopting  sites  in  ways  that  were  not  intended,  such 
as  urban  sites  not  being  willing  to  adopt  programs  originatl/>g  in  rural 
areas.  A  general  rule  may  be  to  describe  only  those  aspects  of  the  context 
that  relate  to  specific  project  goals  and  components.    For  example,  if  a 
project  originated  in  an  area  with  high  mobility  and  developed  techniques 
specifically  for  claasrooms  with  large  numbers  of  students  entering  and 
exiting  during  the  year,  mobility  would  be  an  Important  contextual  cri-* 
terion  for  project  adoption.    By  observing  this  rule,  descriptions  of  the 
originating  PIP  sites  would  omit  discussion  of  features  that  were  not  cri- 
teria for  project  adoption. 

Directives  on  adapting  to  local  coriitions  should  receive  more  Impor- 
tance.   Since  it  was  evident  from  the  field  experience  that  much  adapta- 
tion will  occur.    Apparent  inconsistencies  should  be  corrected  or  explair^d. 
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2*    INSTRUCTIONAL  APPROACH 


2*1    Content  of  Instruction 

2*i,l    Content  Areas  Covered  (Table  C-7) 

Discussion*    The  most  basic  description  of  a  project  is  a  list  of 
the  Instructional  content  areas  covered*    Each  of  the  four  PIPs  provides 
a  slightly  different  list  of  content  areas »  but  they  all  discuss^  however 
brlefly5  readings  rnath^  social  studies^  and  language  arts*  Infomtatlon 
about  the  treatment  of  these  content  areas  In  each  project  appears  In 
three  different  forms:    general  comments  In  the  manuals^  Instructional 
objectives^  or  site  developed  materials*    In  some  cases  Information  Is 
provided  In  only  one  form  (health  In  Nuevos  Horlzontes);  In  other  cases 
Information  Is  provided  In  all  three  forms  (social  studies  In  Sdvolr)* 
Table  C-7  Is  a  summary  of  what  content  areas  are  covered  across  the  PIPs* 


Table  C-7 
List  of  Content  Areas 


Content  Areas 

A 

dell 

e 

Ni'evos 
Horlzont* 

13 

Savolr 

Venceremos 

A 

B 

C 

D 

A 

B 

c 

D 

A 

B  iC 

D 

A 

B 

c 

D 

Lansuase  Arts 
Enftllsh 

* 

X 

X 

X 

French /Spanish 

X 

X 

X 

General 

X 

X 

Secoad  Language 
Instruction 

X 

X 

Reading 
EnRllsh 

X 

X 

X 

French /Spanish 

X 

X 

X 

X 

X 

X 

X 

General 

X 

X 

Hath 

X 

X 

X 

X 

X 

X 

Social  Studies 

X 

X 

X 

X 

X 

X 

X 

X 

Cu Itu  re/her 1 tase 

X 

X 

X 

Science 

X 

X 

X 

Art 

X 

Handwriting 

X 

X 

Health 

X 

Spelllns 

X 

X 

X 

Music 

X 

A  "  General  approach  to  subject  discussed  briefly* 

B  '  Performance  objectives  provided* 

C  «  Specific  procedures  for  Instruction  In  content  area* 

D  -  Site  developed  materials  provide*** 


^Adelante  performance  objectives  &..'e  part  ot  site  developed  materials* 
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Usefulness  to  adopters^    The  lists  of  content  areas  for  each  project 
provided  In  the  PIP  loanuals  are  not  equally  comprehensive  across  the  PIPs« 
Nuevus  Horlzontes  provides  a  comprehensive  llst^  Venceretoos  does  not  ad- 
dress social  studies  and  science^  and  Adelante  and  Savolr  only  discuss 
areas  of  emphasis*    Even  If  a  given  content  area  Is  listed^  what  Is  covered 
under  the  general  heading  'language  Arts^**  for  example^  may  not  be  speci- 
fied.   Out  of  all  four  PIPs^  overall  objectives*  site  developed  materials^ 
and  a  discussion  of  approach  are  only  provided  for  a  total  of  -nly  three 
content  areas:    social  studies  (Savolr)»  Spanish  reading  (Venceremos) »  and 
culture  and  heritage  (Venceremos)*    Even  these  three  areas  are  treated 
generally^  since  specific  procedures^  except  to  the  extent  they  are  lncor~ 
porated  In  slte-developad  materials^  are  not  discussed  for  any  content 
area* 

Because  the  discussion  of  content  areas  does  not  Include  all  areas 
commonly  Included  In  the  elementary  curriculum^  project  Implementers  will 
need  additional  sources  of  Information* 

2«1«2    What  Determines  Content 

Discussion^    The  basic  diffusion  queatlon  here  ls>  "If  an  adopter- 
site  follows  the  PIP  guldellnea^  will  students  In  the  adopter  site  be  ex- 
posed to  the  same  content  as  were  students  In  the  originating  sl£:e?'*  Th"^ 
actual  Instructional  content  of  a  particular  project  Is  determined  by  a 
combination  of  many  factors*  Including  the  role  of  the  teacher^  the  mate^ 
rials  used|  and  Instructional  objectives  from  various  sources*    The  PIP 
projects  allow  the  teachers  a  maxXmum  amount  of  freedom  In  making  dally 
Instructional  decisions*  as  compared*  for  example*  to  programmed  Instruc- 
tion* in  which  the  teacher  makes  almost  no  decisions*     (This  Is  dlscussi^d 
In  Section  2*2*7*) 

Commercial  and  locally  developed  materials  are  specified  for  all  con- 
tent area^^  In  the  three  Spanish /English  PI?6»  and  only  for  social  studies 
In  the  French/English  PIP  (these  are  discussed  in  Section  2*2*6)* 
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In  addition,  all  of  the  PlPs  provide  instructional  objectives  (these 
are  discussed  further  in  Section  2.1.3).    In  Adelants>  the  objectives  are 
inbedded  in  the  site-developed  materials  rather  than  listed  separately^  but 
the  other  three  PIPs  include  a  separate  manual  of  instructional  objectives. 
The  PIPs  state  that  the  objectives  should  be  modified  by  teachers  of  the 
adopting  sites;  Savoir  makes  this  point  most  strongly^  stating  that  the  PIP 
objectives  should  only  serve  as  a  model. 

Usefulness  to  adopters.    There  is  a  fair  amount  f>f  flexibility  in 
determining  instructional  content*    Although  not  necessarily  a  disadvan* 
tage»  many  adopters  expected  more  specific  guidelines  (congruence  with 
goals,  articulation  with  district  curriculum,  instructional  objectives). 

2.1.3    Other  Content  Features 

Discussion.    It  is  important  to  examine  th^.  instructional  content  c>f 
a  special  project  first,  for  its  internal  consistency  and  logic  and  second, 
for  its  articulation  with  the  existing  curriculum. 

Congruence  with  goals:    At  a  general  level,  the  content  areas  discussed 
are  congruent  with  project  goals.    For  example,  Venceremos  i£  the  only  PIP 
that  has  an  explicit  goal  relating  to  culture  and  heritage,  and  consistent 
with  this,  the  Venceremos  PIP  provides  materials,  objectives,  and  general 
guidelines  for  the  instruction  of  culture  and  heritage. 

Articulation  with  district  curriculum:    The  Savoir  PIP  states  that 
the  adopting  district's  curriculum  should  be  followed  except  for  the  areas 
modified  or  supplemented  according  to  the  Savoir  PIP.    The  Nuevos  Hori** 
zontes  PIP  specifies  that  the  bilingual  curriculum  should  parallel  local 
curriculum.    The  other  two  PiPs  do  not  say  how  the  project  should  relate 
ti"  local  curricultm. 

Instructional  objectives:  Comments  from  the  field  tryout  reinforce 
the  first  Impression  that  the  instructional  objectives  are  not  uniformly 
satisfactory.    Because  the  Adelante  objectives  are  imbedded  in  material. 
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chey  do  noc  serve  as  an  overall  guide  for  Ins c race ion  In  an  adopter  slce* 
The  objectives  from  Che  remaining  chree  PIPs  contain  Inconsistencies, 
possible  errors,  and  apparently  arbitrary  decisions  on  the  part  of  the 
packagers*    For  examplei>  Venceremos  reading  objectives  are  given  first  for 
Spanish  reading  and  then  for  reading  In  English  and  Spanish  without  any 
explanation  regarding  such  a  division*    Savolr  lists  only  two  math  objec** 
tlvea  In  French  for  the  entire  year  for  grade  one,  although  suggested  time 
of  Instruction  Is  one  hour  a  week*    Sometimes  a  single  objective  covers  a 
basic  skill  such  as  writing  sentences;  other  objectives  may  cover  much 
smaller  pieces  of  learning  such  as  the  past  tense  of  one  verb*    Some  ob- 
jectives were  written  In  behavioral  terms  and  some  were  not,  even  within 
the  same  PIP* 

Usefulneas  to  adopters*    The  articulation  of  a  special  project  with 
district  curriculum  Is  discussed  only  In  the  Savolr  PIP>  but  such  a  discus- 
sion Is  Important  for  any  Inexperienced  project  director;  however,  because 
of  the  problems  with  PIP  objectives.  In  some  cases  these  did  not  even  pro*- 
vlde  good  models* 

2*1*4    Conclusions  (Instructional  Approach) 

The  content  of  Instruction  for  each  of  the  projects  Is  not  clearly 

specified  by  the  PIPs*    Lists  of  materials,  some  discussion  about  teachers' 

roles,  and  objectives  for  certain  subjects  provide  only  general  guidelines* 

Given  the  elementary  curriculum  already  In  existence  In  an  adopting  site, 

such  general  guidelines  can  be  used  to  modify  and  tailor  that  curriculum 

to  the  needs  of  bilingual  students*    If  the  rules  are  clearly  understood, 

such  general  guidelines  may  be  extremely  helpful  to  new  project  directors* 

However,  the  t  Ps  fall  to  make  their  own  limitations  and  objectives  clear; 

therefore,  field  experience  showed  that  many  new  project  directors  and  most 
* 

teachers  were  looking  for  more  specific  curriculum  guidance  than  could  be 
found  In  the  PIPs*    In  any  case.  It  Is  unlli:ely  that  an  adopter  site  would 
end  up  with  the  same  content  as  the  originating  site,  and  thus,  a  major 
element  of  the  presumably  exemplary,  orlglnatlng-slte  projects  would  not 
be  diffused  via  the  PIPs* 


423 


2*2    Presentation  of  Content 


To  assure  replication  of  a  model  project »  it  is  not  enough  to  de- 
scribe the  instructional  contents    The  methods  and  techniques  of  present^ 
ing  that  content  should  also  be  described  in  sufficient  detail  so  that 
personnel  in  adopting  sites  can  duplicate  these  procedures*    Xhe  follow^ 
ing  paragraphs  summarize  PIP  directions  for  each  instructional  variable^ 


2*2a    Instructional  Model  (Table  C*8) 


Discussion*    All  of  the  PIPs  refer  to  guiding  principles  that  can  be 
termed  instructional  models^    Some  of  these  are  general  and  some  refer 
only  to  bilingual  education*    The  PIPs  vary  in  how  central  any  particular 
model  is  in  replicating  the  projects*    For  example*  cooperative  teaching 
is  required  in  Adelante»  but  is  optional  in  Nuevos  Horizontes  and  Vence* 
remos*    The  models  referred  to  in  each  PIP  appear  in  Table  C-8* 


Table  C-8 


Instructional  Mbdels 


General 
Instructional 
Mbdel 


Bilingual 
Instructional 
Model 


Ad elan te 


Child^centered 
classroom 

Cooperative 
teaching 


Mix  of  English 

and  Spanish 
about  half  &nd 
half  by  end  of 
first  grade 


Uuevos 
Hori2ontes 


Child-centered 
classroom 

Optional 
cooperative 
teaching 

Use  of  both 
languages  on 
alternate 
weeks »  days» 
or  class 
periods* 


Savoir. 


Child *cen  tered 
classroom 

Questions- 
answer 
approach 

Use  of  non- 
English 
language  for 
relevance  to 
child  and 
enrichment* 


Venceremos 


Child^cen tered 
classroom 

Optional 
cooperative 
teaching 

Recommended 
use  of  both 
languages  on 
alternate  days 
or  weeks  by 
the  end  of 
grade  one* 
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UsefulnesB  to  adopters*    Instructional  models  are  discussed  in  all 
of  the  PIPs*    Some  are  merely  mentiou^d*  and  others  are  discussed  at 
greater  length  but  still  in  general  terms*    Explanations  o£  how  to  use 
these  models  are  not  in  sufficient  detail  for  a  qualified  educator  to 
implement  them  without  previous  expt^rien^^e  *    That  the  PIPs  were  not  de- 
signed to  give  this  level  of  detail  is  clear  when  the  Nuevos  Horizontes 
PIP  recommends  attending  a  workshop  on  the  child-centered  classroom  if 
more  information  is  needed*    None  of  the  laodols  represents  ^  major  inno- 
vation*   Because  of  their  generality »  the  models  are  only  useful  in  plan- 
ning program  theory  ana  not  in  actual  program  ImplemeTttation* 

2*2*2   Methodologies  for  Bilinajtal  Education  (Table  C-9) 

Discussion.    The  four  issues  described  here  must  be  resolved  by  any 
instructional  program  that  uses  more  than  one  language  (see  Table  C*9}* 

•  Lenguage  of  Instruction;    The  PIPs  provide  percentages  for  lan- 
guage use»  but  they  also  stress  flexlbility»  accepting  communi- 
cation from  the  child  in  any  language*  and  introducing  concepts 
In  the  dominant  language*    There  is  no  clear  resolution  of  these 
potenliially  conflicting  directives* 

•  Approach  to  non-8tandard  form;    All  the  PIPs  stress  accepting 
the  language  of  the  child*    General  guidelines  are  given  for 
increasing  the  students^  knowledge  of  standard  usage* 

•  Approach  to  second  langMafee  instruction;  Language  development 
is  a  cornerstone  of  bilingual  projects*  The  PIPs  provide  gen- 
eral directives*  but  no  specific  methodology* 

•  Approach  to  reading  instruction  (Table  C-10);    An  Important  deci- 
sion for  any  bilingual  project  is  deciding  in  what  language  stu- 
dents learn  to  read*    Table  C*IO  summarizes  the  PIP  directives  on 
this  subject*  which  are  quite  clear*    However*  two  of  the  PIPs  do 
not  state  at  what  point  reading  instruction  should  begin  in  the 
aecond  language* 
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Table  C-9 


Methodologies  for  Bilingual  Education 


A 

HH 

s 

V    !  Comments 

Lanftuafte  of  Instruction 

!•  language  use  plan  for 
teacher  and  student 

1 

1 

1 

1 

The  three  Spanish/English  PIPs  state  that  equal 
instructional  tiste  in  each  language  is  the  goal 
by  the  end  of  first  grade.    The  French/English 
PIP  states  that  the  mix  should  be  2/3  English, 
1/3  French. 

2.  daily  instructional 
time  in  each  language 

1 

1 

1 

1 

Suggested  schedules  are  given  but  no  detailed 
plans  or  criteria  for  developing  a  specific^ 
adopter-site  schedule. 

3.  variation  for  differ- 
ent student  groups 

0 

1 

1 

1 

Beyond  the  instruction  to  group  students,  no 
variations  are  given  for  different  student 
groups  in  three  PIPs.    Nuevos  Horizontes  has 
schedules  for  English  speakers  and  schedules 
for  Spanish  speakers^  but  the  PIP  does  not  de- 
scribe what  English  dominant  students  do  in 
Spanish  reading,  for  example. 

4.  criteria  for  estab- 
lishing language  of 
instruction 

1 

1 

1 

1 

The  general  criterion  is  to  introduce  concepts 
in  the  language  the  child  understands  best  and 
to  reinforce  in  the  second  language. 

Kelt 

A  «  Adelante;  NH  «  Nuevcs  Horizontes;  S  «  Savoir;  V  «  Venceremos 

0  "  not  mentioned;  1  «  general  comments,  guidelines,  tips;  2  «  comprehensive  and  specific 
instructions 
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Table  C-9  (Continued) 


A 

m  1 

s 

V 

Comments 

Approach  to  Non-Standard 
Forms 

I*  acceptance 

2 

2 

2 

2 

Stated  clearly  in  all  PIPo* 

2*  form  of  correction 

I 

I 

I 

I 

The  Savoir  PIP  instructs  teachers  to  correct 
students  by  agreeing  with  the  communication 
but  repeating  it  In  standard  English  or 
French*    The  other  PIPs  call  for  pattern 
drills  at  a  later  time* 



Ajipjrvncn  CO  occvnu 

LancuaKe  Instruction 

Axtnuugn         cne  ir i-irs  recognxze  cne  xmporcance 
of  this  area,  methods  given  are  very  general, 
e*g*,  Savoir^    ^'shift  emphasis  to  rural/oral 
skills,*'  Venceremos:    "(teach  oral  language 
through)  follovlng  directions,  answering  specific 
questions,  using  new  vocabulary  in  complete  sen-* 
tences*" 

Table  C-10 


Approach  to  Reading  Instruction 


PIP 

Adelante 

Nuevos 
Horlzontes 

Savolr 

Venceremos 

1.  Language  In  which  stu* 
dents  begin  to  read 

2  Spanish 

1    native  language 
(English  or 
Spanish) 

2  English 

2  Spanish 

2*    Criteria  for  beginning 
reading  In  second  lan- 
guage 

1    Some  under- 
standing of 
English 

0  Unclear 

1    Third  grade 

1    Middle  of 
first  grade 

0    °    not  mentioned;  1    -    general  tips;  2    =    specific  instructions 
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Usefulness  to  adopters*    Accepting  the  language  of  the  child  is  the 
bilingual  education  practice  which  Is  covered  most  adecjuately  in  the  PIPs* 
It  is  also  one  of  the  simplest  practices  to  explain*    Other  methodologies 
and  strategies  for  bilingual  instructiovi  are  cc/vered  so  generally  that  they 
leave  many  questions  in  the  ^    ler's  mindi  as  verified  by  field  experience* 
For  example,  the  general  directive  to  divide  instructional  time  between 
both  languages  does  not  answer  the  following  questions:    Which  subjects  or 
which  portions  of  subjects  should  ji  in  which  language?    How  should  conti- 
nuity and  switching  language  be  handled?    How  is  the  language  of  the  ac" 
mpanying  materials  to  be  treated?    Can  students  respond  in  any  language 
or  should  they  be  required  to  respond  in  the  language  of  instruction? 

The  whole  ic;sue  of  reading  instruction  is  very  important  in  bilingual 
education,  and  the  PIPs  are  not  clear  on  issues  such  as  whether  readiness 
should  be  taught  in  both  laaguages,  and  at  what  point  a  student  should 
begin  to  read  in  the  second  language     Directives  such  as  students  will 
begin  English  reading  by  the  middle  of  first  grade  need  simplification  in 
order  to  be  meaningful  in  an  individualized  program*    Field  experience 
fihoved  that  these  were  important  issues  for  adopter  sites  and^  in  order 
to  make  out  decisions^  they  had  to  consult  sources  other  than  the  PIPs* 
The  PIPs'  discussions  of  language  use  assume  that  all  students  enter  the 
program  in  kindergarten  or  first  grade  and  do    ot  take  into  account  that 
the  problemr  discussed  above  may  be  complicated  by  recent  arrivals  at  all 
grade  levels  * 

However^  thp  use  of  two  languages  for  instruction  is  a  major  educa-^ 
tioital  innovation  in  most  districts*  and  the  discussion  of  methodologies 
may  have  some  use  in  program  design,  within  the  limitations  discussed 
above* 

2*2*3    Specific  Methodologies  for  Each  Subject  Area 

Disc'jssion*    The  PIPs  discuss  overall  approaches  to  the  content  areas 
listed  in  Table  C**?*    Discussion  of  some  scMects  may  be  limited  to  only 
one  sentence  such  as  the  Nuevos  Horizontes  directive:    *'For  social  studies^ 
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each  teacher       s  textbooks  in  Spanish  from  which  he  or  she  reads  excerpts 
related  to  topics  in  the  English  text*"    The  longest  discussions  may  in^* 
volve  two  or  three  paragraphs^  such  as  the  following  treatment  of  social 
studies  by  Savoir: 


The  project's  approach  to  social  studies  is  original^ 
developed  by  the  staff  and  is  the  core  of  the  French  i*-o* 
gram*    It  is  the  umbrella  for  Instruction  in  history^ 
geography^  biography^  language^  sociology^  and  economics^ 
using  an  approach  that  begins  with  students  studying  their 
imL,Gdiate  environment  and  then  proceeding  outward: 


Kindergarten  ^  self-image 

First  level   ^  environment 

Second  level  ^  my  town 

Third  level   -  Maine  and  New  Bruns\^ick 

Fourth  level  *  New  England »  Quebec »  Louisiana 

Fifth  level    ^  North  America 


Booklets  to  teach  the  topics  shown  here  were  generat^^d  bv 
the  developer  site*    (A  set  of  these  is  included  in  this 
PlPt)^    Adopting  projects  will  have  to  develop  lessons  <.nd 
materials  about  their  own  towns*    Further^  the  concept 
underlying  the  materials  for  levels  3  through  5  is  that 
the  children  should  study  areas  Where  there  are  significant 
numbers  of  Acadians  and  French~Oanadians»  starting  with 
their  own  area*    (For  the  developer^  this  was  Maine  and  New 
Brunswick*)    A  project  in  Louisiana >  for  example >  should 
discus^^  placing  the  study  of  Louisiana  in  level  3  and  should 
modify  the  materials  as  necessary* 


Usefulness  to  adopters*    None  of  the  PIPs  provided  methodology  in 
enough  detail  to  be  very  useful  at  the  classroom  level*    The  most  compre* 
hensive  guideljlnes^  such  as  those  for  social  studies  in  Savoir^  would 
still  require  cousiderable  filling  in  froiii  a  knowledgeable  and  creative 
teacher*    None  of  the  methodologies  were  innovative^  although  their  appli** 
cation  to  a  bilingual  setting  m^  have  been*    Discussions  of  methodology 
may  be  useful  at  the  general^  program-'planrJng  levels  but  they  were  not 
useful  to  teachers* 


*Thert:  were  no  K-4  materials  in  the  PIP>  only  materials  for  upper 
grades  which  wore  not  covered  by  the  PIP* 
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2*2*4  Rate 


Discussion*    This  category  Is  an  Important  Instructional  variable  con*- 
slstlng  of  two  parts,  the  pace  of  Instruction  and  the  total  time  available 
for  each  content  area* 

•  Variation  In  pace*    All  the  PIPs  require  that  the  students  be 
grouped  along  criteria  which  Imply  variation  In  the  pace  of 
Instruction*    Only  Venceremos  states  that  students  are  given 
mastery  tests  at  the  end  of  each  unit  and  receive  additional 
Instruction  If  they  do  not  pass*    The  PIPs  do  not  discuss  whether 
the  pace  Is  set  by  the  group  or  by  the  Individual* 

•  Time  on  task*    The  amoum:  of  time  per  day  allocated  to  each 
content  area  Is  dlscusse'l  under  "Schedule*"    The  PIPs  do  not 
distinguish  the  time  that  the  student  Is  actively  engaged  In 
producing  responses  and  receiving  feedback  from  the  gftneral 
schedule,  which  usually  Includes  much  "passive"  behavior* 

Usefulness  to  adopters*    The  Issue  of  rate  of  student  learning  Is 
either  Ignored  or  covered  minimally*    Because  bilingual  education  gl/es 
considerable  Importance  to  language  learning  and  to  language  development, 
the  amount  of  Individual  response  time  could  be  a  significant  program 
feature*    In  addition,  because  bilingual  education  Is  an  alternative  pro*- 
gram,  allowing  students  to  learn  at  a  rate  that  Is  more  appropriate 
tor  them  could  be  extremely  important* 

2*2»5    SelfH^oncept  Development  and  Motivation  (Table  C-ll) 

Discussion*    Improving  self^concept  Is  a  goal  In  all  four  PIPs,  but 
this  goal  Is  not  attributed  to  aiy  particular  component  of  the  projects* 
Therefore,  this  discussion  Is  based  on  these  aspects  of  the  projects  that 
are  generally  expected  to  affect  the  student's  self  ^-concept  and  motivation* 
Table  C-11  stnmnarlzes  what  can  be  found  In  the  PIPs  on  this  subjects 


Table  C-11 


Self-CoocePt  and  Motivation 


A 

HR 

s 

V 

Comments 

Appropriate  content  and 
language  of  Instruction 

1*  Using  LI  for  Instruc- 
tion 

1 

1 

1 

1 

See  discussion  of  bilingual  methodology  (p.  C-31)* 

2*  Accepting  the  language 
of  the  child 

2* 

2 

2 

2 

Stressed  In  all  PIPs. 

3.  Content  that  relates 
to  students'  exper* 
lence 

0 

i 

1 

i 

0 

Savolr's  "umbrella"  social  studies  flan  calls  for 
beginning  with  the  student's  Immediate  world  and 
expanding  It*    Huevos  Horlsontes  provides  "tips" 
such  as  Including  food  normally  eaten  by  the 
children  In  a  study  of  nutrition.    Xhe  other 
two  PIPs  do  not  mention  this  are*^* 

4*  Culturaly  relevant 
material 

1 

1 

1 

1 

Each  PIP  provides  lists  of  commercial  materials 
and  site  developed  materials »  some  of  which  are 
tailored  to  the  cultural  backgrounds  of  the 
students. 

Key; 

A  «  Adelante;  KH  «  Kuevos  Horizontes;  S  =  Savolr;  V  =  Venceremos 

0  °  not  mentioned;  1  °  general  comments*  guidelines,  tips;  2  -  ccMioprehensive  and  specific 

Instructions;  *  ~  discussion  In  the  PIPs  rt^Xate  this  feature  to  self^coucept  and  motivation 
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Table  C-11  (Continued) 


A 

HH 

s 

V 

Comments 

Improved  affective  cli- 
mate 

1*  Placing  equal  value 
on  both  languages 
and  cultures 

1 

1 

1 

1 

The  PIFs  stress  acceptance  of  any  language  the 
child  uses,  and  they  call  for  instruction  in 
both  languages  and  about  both  cultures* 

2.  Insuring  student 
success 

1 

0 

0 

1 

Adelante  calls  for  providing  the  child  with  suc- 
cessful experiences*    Venceremos  requires  the  use 
of  mastery  tests;  students  who  fail  are  provided 
with  further  instruction* 

3*  Involving  parents 

1 

1 

1 

1 

All  the  PIFs  discuss  parent  involvement.  Certain 
areas  received  detailed  attention:    e.g.,  Adelante 
provides  instruction  sheets  for  parents  and 
teachers  to  work  together  in  the  classroom.  Field 
experience  indicates  more  detail  wa:«  needed  for 
other  areas. 

4.  T  as  a  role  model 

0 

0 

0 

0 

Not  discussed  in  any  of  the  PIFs. 

Disciplite  approach 

0 

0 

0 

0 

Not  discussed  in  any  of  the  PIFs. 

Special  rewards  system 

0 

0 

0 

0 

Not  discussed  in  any  of  the  PIFs. 

•  Appropriate  content  and  language  of  Instruction!    The  appropriate^- 
nesd  of  the  content  Is  not  discussed  syatematlcall.   in  any  of  the 
PIPs.    There  are  occasional  references  to  It;  for  example*  Nuevos 
Horlzontes  states  that  discussions  of  nutrition  should  Include  the 
foods  normally  eaten  by  the  children.    Inclusion  of  the  students' 
culture  and  heritage  is  mentioned  in  all  the  Pips.  Instruction 

in  two  languages  is  discussed  throughout  the  PIPs»  but  there  are 
no  rulea  for  determining  when  the  use  of  a  particular  ,language  is 
appropriate. 

•  Improved  affective  climate!    This  is  a  goal  in  all  four  PIPs. 
The  desired  ou«:come  is  discussed  (e.g.,  students  should  volunteer 
communications  more  frequently*  students  should  have  a  positive 
self-image)  and  general  guidelines  are  provided  (e.g.»  accept 
the  language  of  the  child,  instruct  the  child  in  both  cultures). 

Discipline  approaches  and  special  reward  systems  are  no^  discussed 
in  the  PIPs. 

IJsefulneas  to  adopters*    Some  aspects  of  aelf-concept  development 
are  treated  thoroughly,  for  eKampl^,  involving  parents  and  determining 
the  language  of  instruction.    Other  areas,  such  as  the  use  of  culturally 
relevant  materials,  are  not  treated  specifically,  although  the  project  as 
a  whole  may  address  these  issues.    Still  other  areas,  such  as  special 
rewards  systems  or  discipline,  are  ignored  completely.    The  PIPs  state 
the  desired  outcomes,  e.g.,  a  positive  self^-concept,  which  seem  to  be  the 
expected  results  of  the  total  program.    There  is  nothing  innovative  in 
the  treatment  of  self-concept,  but  the  discussion  is  useful  at  the  pro- 
gram planning  level. 
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2.2.6    Materials  (Tables  C-12  and 


Discussion.    Core  matArlals  consist  of  slte<"developed  materials  and 
recommended  commercial  materials.    Commercial  materials  are  llstert  In  the 
PIPs  with  publishers'  names  and  addresses.    The  three  Spanish-English  PIPs 
consider  the  commercial  materials  to  be  an  essential  part  of  the  project. 
Savolr  lists  the  commercial  materials  only  for  lllustratlon»  because  the 
French-English  PIP  recommends  continuing  with  whatever  Is  currently  used 
In  the  district.    Since  material  lists  for  all  five  grades  In  the  four 
PIPs  would  be  extr^nely  lengthy»  grade  two  was  selected  as  an  example* 
and  the  lists  of  texts  for  that  grade  appear  In  Table  C-I2.    Some  of  the 
similarities  In  materials  can  be  attributed  to  the  effect  of  the  state-* 
approved  textbook  list  on  the  three  Spanish/English  Texas  sites.  Locally 
developed  materials  are  considered  part  of  the  PIP.    The  materials  devel- 
oped at  each  site  are  listed  In  Table  C"13.    Appropriateness  of  the  mate- 
rials Is  not  dlscu^^sed  In  any  of  the  PIPs. 

Usefulness  to  adopt^is.    The  lists  of  commercial  materials  for  the 
Spanish /English  PIPs  Include  addresses*  price  estimates*  and*  In  some 
cases*  quantity  needed  per  clsss.    The  lists  are  not  annotated  beyond 
assigning  each  text  to  a  grade  level  and  a  subject  area.    Therefore*  the 
list  Is  of  little  use  to  an  adopting  site  wishing  to  select  books*  and 
unable  or  unwilling  to  order  everything.    Because  materials  are  the  part 
of  the  program  most  likely  to  become  obsolete*  this  section  of  the  PIP  did 
not  enjoy  usefulness  Aven  Into  the  field  test  period.    The  slte**developtid 
materials  are  clearly  original*  but  are  no  more  Innovative  than  other  sim- 
ilar materials.    Some  site  developed  materials  contained  a  larger  amount 
of  errors  than  adopter  sites  were  willing  to  tolerate.    The  more  experi- 
enced adopters  often  disregarded  the  material  recommendations  entirely. 
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Table  C-12 
Core  Commercial  Materials  (Second  grade) 


Adelante 

Nuevos 
Horlzontes 

Savolr* 

Venceremos 

Language 
Arts 

Our  LanRua£e  Today 
American  Book  Co. 

Mi  Prlmera  Gram* 
matlca 

Edltorlale  Trlllas 

Eierclclos  de  Len* 
ftjuafie 

Heffernon's 

Teachlnfi_Jn£llsh 
Sounds  to  Spanish 

Jacaranda  Indlvirl- 
uallzed  Lan^ua^ 

Same  as  Adelante 

Speakers 
Allied  Educa  tional 
Council 

BlllnfEual  Film 

Strip  ProRram: 
Imperial  Educational 

Resources 

Arts  Program 
tJacaranda  Pr^s^ 

Language  Master 
Series:    Par Ions 
Franffals  ALAP 

Bell  and  Howell 

Reading 

Laldlaw  Brothers 
opanisn  neaaing 
Series 

Harper  &  Row 
Basic  Reading 
Program 

Amanecer^  El  Nuevo 

 *  

Laldlsw  Brothers 
Spanish  Reading 
Series 

Bookmark  Reading! 

Program 
Harcourt  Brace 

Jovanovlch 

Continuous  Progress 

in  Readln£ 
Economy  Company 

Read ins  360 

61 nn  and  Company 

Laldlaw  Brothers 
opanisn  neacing 
Series 

Harper  &  Row 
Basic  Reading 
Program 

Amanecer^  £1  Nuevo 

Spifilirados  ^  Mis 
Prlmera  Luces« 

Fernandez  edltores 

Basal  Reading 
Series 

Harcourt  Brace» 

Jovanovlch 

Prlmera  Luces* 
Fernandez  edltores 

^Savolr  did  not  list  material  by  grade  level*  so  this  list  provides  only  a  i^ample  of  books  listed 
I  and  may  not  reflect  actual  second  grade  use. 


Table  C-12  (Continued) 


Adelante 

Nuevos 
Horlzontes 

Savoir* 

Venceremos 

Hath 

1 

Eleinentanr  School 

Modern  School  Math 

Elementary  School 

Elementary  School 

Mathematics 
Addlson-Wesley 
(English  and 

Spanish  Versions) 

Houghton  Mifflin 

Mathematics 
Addl  s  oa**We&  ley 

Individual  Progress 

Instruction 
Appleton-Century- 

Crofts 

tfath 
Addison-^Wesley 
(Spanish  Version) 

Sample  of 

Other 
Subjects 

Multlculture 

Social  Education 

ProMam 
Southwest  Educa-' 

tlonal  Develop-* 

ment  Laboratory 

Basic  Goals  In 

Spelling  Series 
McGraw-Hill 

The  Laidlaw  Science 

Series 
Laidlaw  Brothers 

Contenus  en  espaSol 
Kjo» 

Hone  listed 

^Savolr  did  not  list  material  by  grade  level,  so  this  list  provides  only  a  sample  of  books  listed 
and  may  not  reflect  actual  second  grade  use* 


Table  C-13 
Locally  Developed  Materials 


Adelante 

'  Nuevos 
Horizontes 

Savolr 

Venceremos 

Ml  Amblente  y  Yot 
Aural-Oral  Activity 
Guide  (Spanish  and 
English  versions) 

1-7 

f*f\m  n  d  n't  f\n  rt 

La id law  series 
Vamos  a  Platicar* 

Bilingual  Kinder^ 

fan  TriQ^fllP* 

tlonal  Resource 

Oct  O  X W    £f  Un  X  XSt  J 

for  Spanlsh- 

A  xo  maxson 
'•Hon  village" 

Chez  Nous:    Ma  Famille 

Six  units  for  K-2 
on  these  topics — 
Pollution  and  Me, 

OOme  ctQu  *  cuuxxjr  , 

The  School,  The 
Farm,  The  Zoo,  and 
aeaxcn  anu  oarecy 
(Spanish  and 
English) 

Ml  Herencia  Cultural 

Speaklnf^  Students 

vfics  nous «     rut  xoxct 

Spanish  for  the 

Chez  Nous:    Mon  Vlllaj!e 

Histolre  des  Acadiens 

Spanish  Speakinj^ 

Mon  pays:    Van  Buren 

\is.— 4  resource  dooivj 
La  Escuellta  de 

Aural-^Oral  Activity 

Student  in  Ele- 

vuxQe 

mentary  Grades 

non  pays •  rrencnvxxxe 

De  Que  PlaticamoSt 

1*6 

Spanish  Reading 
Activities 
companion  to 
commercial  text 
"Mis  Primeras 
Lettras" 

Supplementary  Mate- 
for  Enrichment 

ec      ^  Agacne 
Mon  pays:  Madawaska 

urx  t^rx  vgraQes 
K-l)  Spanish 
reading 

La  nlstoria  ae 

Aural*Oral  Activity 
Guide 

Spanish  Social 
Studies  Handbook t 

Histolre  des  Acadiens 
Je  Voyafie  (*n  Nouvelle^ 

AnKleterre 
Je    jyaee  Canada 

Mario  (srade  1) 
Mis  Aminos 

levels  I-III 

Je  Voyafie  en  Louis lane 

(grades  3-4) 

Unn/lKAAt^            R1 A^ 
nanQDOOK  v£  JaXc^ 

mentary  Science 

Spanish  Languaf^e 
Resource  Book 

Experiments. 
LaClencla : 
Experlmentos 
Element ales 
(Spanish) 

3o  < 


2.2.7    Personnel  Roles  In  ClasBroom  Instruction  (Tables  C-14  and  C-15) 


Discussion.    The  role  of  Instructors  or  the  Instructional  configura- 
tion specified  by  s  project  may  represent  inaj*:;r  changes.    The  PIP-specif led 
roles  of  teachers  and  others  In  clsssroom  Instruction  are  summarlsced  In 
Table  C-14.    The  role  of  parents  In  the  classroom,  the  role  of  the  aides, 
and  the  Involvement  of  resource  staff  appear  to  be  the  major  differences 
among  the  projects.    Because  role  descriptions  In  some  PIPs  are  more  de- 
tailed than  others,  It  Is  difficult  to  judge  whether  these  differences  In 
description  represent  real  project  differences  or  not. 

The  classroom  Instructional  configurations  of  the  projects  are  com- 
pared In  Table  C-l5,^ 

Usefulness  to  adopters.    The  recommended  number  of  teachers  and  aides 
and  students  Is  clearly  defined  for  each  project.    Since  the  teacher  aides 
In  Savolr  are  available  by  teachers''  request,  the  effect  on  budgeting  and 
staff  selection  Is  unclear*    Nuevos  Horlzontes  allows  25  students  per  class 
while  the  other  projects  sllow  up  to  35  students.    Since  these  numbers  are 
not  referred  to  In  any  classroom  strategy,  they  probably  reflect  practices 
at  the  originating  site.    These  recommendations  were  of  little  or  no  use  to 
adopters,  since  local  considerations  determined  class  sizes. 

Teachers"^  roles  do  not  appreciably  differ  across  the  PIPs*    Their  role 
Is  defined  in  general  terms  such  as  "conduct  bilingual  Instruction."  While 
there  is  more  apparent  difference  in  the  roles  of  aides,  parents,  and  re- 
source staff,  this  could  be  a  result  of  the  way  these  roles  are  described 
in  each  PIP.    For  example,  the  job  description  of  the  aide  In  Adelante  does 
not  Include  assisting  with  classroom  instruction  or  reinforcing  concepts. 
Apparently  the  aides  of  the  Adelante  project  were  not  responsible  for  any 
instruction  to  groups,  but  since  this  distinction  Is  not  explicitly  stated 
In  the  text,  field  experience  showed  little  difference  In  the  role  of  aides 
role  across  the  four  PIP  projects. 
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Table  C-14 


Personnel  Roles  In  Classroom  Instruction 


A 

m 

s 

V 

Teachers 

Conduct  blllnRual  Instruction 

X 

X 

X 

X 

Provide  a  maximum  of  Individualized  Instruction 

X 

X 

Administer  masterv  tests 

X 

X 

Aides 

Assist  In  classroom  Instruction 

X 

X 

Reinforce  concepts  tauKht  bv  the  teacher 

X 

X 

Tutor  Indlvluuai  students 

X 

X 

X 

X 

Check  students  work/help  evaluate  student 
achievement 

X 

X  _ 

_x 

Supervise  classroom  or  recreational  activity 

X 

X 

X 

Organize  activity  areas*  distribute  materials 

X 

X 

Read  stories  to  children 

X 

X 

Parents 

Assist  In  classroom  Instruction 

X 

X* 

X 

Tutor  Individual  students 

X 

Peers 

Resource  Staff  (iCs,  etc.) 

Assist  teachers  with  the  transition  from 
Instruction  In  Spanish  to  Instruction 
In  both  English  and  Spanish 

X 

X 

SuBfiest  appropriate  Instructional  strategies 

X 

X 

X 

Observe  classroom  Instruction 

X 

X 

X 

X 

A    »  Adel^nte;  NH  -  (luevos  Horlzontes;  S    >  Savolr;  V   »  Venceremos 


*Optlonal 
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Table  C-15 


Classroom  Instructional  Configuration 


Adelante 

Nuevos 
Horlzontes 

Savolr 

Venceremos 

Suggested 
number  of 
Students  per 
Teacher 

25-35  students 

25  students 

25-35  students 

25-35  students 

Htnnber  of 
Aides 

Full-time  aide 
for  K;  half- 
time  aide  for 
grades  1^^ 

Half -time  aide  for 
each  classroom. 

Aides  optional; 
available  at 
teacher's  request. 

Full-time  aide  for 
K;  half-time  aide 
for  grades  1*4* 

2.2.8    Conclusions  (Presentation  of  Content) 


Instructional  methods  and  techniques  are  not  discussed  In  detail  by 
any  of  the  PIPs.    Guidelines  are  provided  about  bilingual  Instruction  such 
as  the  use  of  each  language  should  be  equal  by  the  end  of  first  grade. 
However»  anyone  attempting  to  follow  these  guidelines  would  naed  addl* 
tlonal  Instructions  that  are  not  found  In  the  PIPs.    Desirable  outco]nes» 
e.g.,  a  positive  self-concept >  are  discussed  but  no  specific  Instructions 
are  given  for  achieving  them>  other  than  Implementation  of  the  total  pro- 
gram.   Instructional  msterlals  are  lls^ted  In  detail^  but  the  same  reasons 
wh:.ch  made  these  materials  practical  In  the  originating  site  (e.g.^  that 
they  were  state^adopted  texts)  may  preclude  their  use  In  adopter  sites 
from  other  states.    The  roles  of  teachers  and  other  Instructors^  such  as 
parents  and  aides ^  are  described^  although  some  of  the  tasks  may  be  all- 
encompassing^  e.g.,  "to  conduct  bilingual  instruction. The  PIPs'  major 
accompllshinent  Is  to  provide  general  Information  on  Instructional  strategy^ 
and  to  provide  staff  configurations  and  descriptions  of  roles.  Therefore^ 
the  packages  vere  more  useful  to  administrators  than  to  teachers,  and  the 
PIPs  are  primarily  a  management,  not  an  instructional  system. 

From  a  diffusion  standpoint,  even  If  an  adopter  could  follow  the  PIP 
specifications  completely^  because  of  the  generality  of  these  speclflca* 
tlons,  the  resulting  Instruction  would  very  likely  differ  s«bstantlally 
from  that  In  the  originating  site.    Changes  In  mjor  elements  of  the  proj** 
ects  (e.g.^  team  teaching;  basic  tests)  further  exaggerated  the  differences 
In  the  PIP  field-test  sites* 


2*3    Student  Selection 


2*3*1    Entry  Criteria  (Table  C-16) 

Discussion*    The  general  Information  provided  by  the  pips  on  entry 
criteria  1&  summarized^  In  Table  C-16*    Instead  of  providing  specific  pro- 
cedures»  three  of  the  pips  state  that  procedures  must  be  developed*  All 
the  Pips  note»  realistically*  that  state  or  local  policies  may  Influence 
selection* 

Usefulness  to  adopters*    xhe  PIPs  correctly  state  that  local  proce- 
dures may  Influence  student  selection*    In  View  of  that  fact»  extensive 
selection  procedures  for  each  PIP  would  be  Inappropriate*    However*  a  dis- 
cussion of  student  selection  Issues  could  have  assisted  project  planners 
In  this  Very  important  area* 

2>3*2    Exit  Criteria 

There  Is  no  mention  of  exit  criteria  or  procedures  In  any  of  the 

PIPs* 

Usefulness  to  adopters*    Not  discussed* 

r.  •  3  *  3    Conclusions  (Student  Selection) 

Student  selection  Is  a  key  Issue  In  designing  a  successful  bilingual 
project*    The  Issues  are  not  always  clear  to  bilingual  education  profes- 
olonals»  and  an  Inexperienced  project  director  would  need  much  more 
guidance  In  this  area  than  Is  provided  In  the  PIPs* 
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Table  C-16 


Student  Selection 


Adelante 

Nuevos 
Horlzontes 

Savolr 

VenPAr^Q^S 

Target 
Population 

Students  in 
achools  with 
high  percentages 
of  bilingual 
children* 

Underachieving 
students  of 
limited  English 
speaking  ability* 

This  may  be  deter* 
mined  by  the 
funding  agency* 

Students  in 
schools  with  large 
number  of  Spanish- 
dominant  students. 

Entry 
Criteria* 

Student  Is 
volunteered 
by  parent. 

Teacher*prlnclpal 
judgment  *  Assess- 
ment of  language 
proficiency  and  of 

Unat  be  decided 
by  adopter « 

Student  is  volun- 
teered by  parent « 

Entry 

Procedures 

Develop  pro- 
cedures with 
evaluator* 
Obtain  parental 
consent • 

Develop  procedures 
with  evaluator* 
Obtain  parental 
consent « 

Develop  procedures 
with  €\^aluator« 
Obtain  parental 
consent « 

Inform  parents, 
so  parents  may 
volunteer  stu** 
dents . 

Exit 

Criteria 
and 

Procedures 

None. 

Hone. 

None* 

None* 

*The  PIP  notes  that  state  or  local  policies  may  Influence  selection. 
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2.4  Schedullnft 


Scheduling  refers  to  the  organization  of  students  into  groups  or 
classes  for  defined  periods  of  instruction. 

2.4.1    Grouping  (Table  C-17) 

Discussion.    Grouping  is  a  requirement  in  all  four  projects  and  the 
specific  PIP  directives  are  summarized  in  Table  C-17.    All  of  the  intruc- 
tions  are  at  the  general  level  indicated  by  the  table. 

Usefulness  to  adopters.    The  introduction  of  bilingual  inatruction 
con^licates  the  classroom  ntanagement.    The  addition  of  instructional  aides 
and  the  use  of  grouping  are  two  means  of  coping  with  the  increased  com* 
plexity.    The  PXPa  provide  enough  information  about  grouping  for  general 
program  planning  purposea.    However*  the  kind  of  detail  needed  by  an  in- 
structional consultant  or  a  teacher  is  not  present.    For  example,  the 
three  Spanish-English  PiPs  recommend  grouping  according  to  lenguage  pro- 
ficiency*  but  no  assessm*»nt  procedures  or  steps  are  provided. 


445 


Table  C-17 


Grouping 


Ade Xante 

Nuevos 
Horizontes 

Savoir 

Venceremos 

Basis  for 
Grouping 

Language  pro- 
ficiency and 
achievement • 

Language  profi- 
ciency and 
ach ievement. 

Performance  and 
tieed  (specifi* 
cally  not  lan- 
guage dominance)* 

Language  profi- 
ciency and/or 
achievement  level. 

Locus  of 
Group 

Within  and 
across  classes* 

Within  class* 
Kay  be  across 
classes. 

Within  class. 

Within  class. 
Kay  be  across 
classes^ 

Subjects 
Affected  hy 
Grouping 

Especially 
language  arts 
and  reading 

Not  stated. 

Each  content 
area. 

Usually  limited 
to  language  arts 
and  reading* 

Permanence 
of  Group. 

Should  change 
often. 

Not  stated. 

Not  stated. 

May  change  often. 

Criteria 

Not  stated. 

T&st  scores, 
past  school 
records,  in* 
formal  obser- 
vation . 

Mastery  of 

performance 

objectives. 

Teacher  obser- 
vation. 

2*4*2    Daily  Schedules  (Table  C-18) 


Discussion*    None  of  the  PIPs  require  adherence  to  a  schedule  since 
variation  is  allowed  even  In  content  aress  covered*    Hovever*  all  the  piPs 
provide  at  least  one  sample  schedule*    Table  C*18  suicmarlzes  the  schedul- 
ing Information  provided* 

Usefulness  to  adopters*    Xhe  PIP  schedules  represent  what  occurred 
at  the  originating  sites >  complete  vlth  the  recess  and  lunch  schedules  for 
those  sites*    Vencerm)s  offers  several  examples  per  grade  level*  and  the 
content  areas  may  be  labeled  differently  In  each  example*    in  some  cases 
there  Is  a  genersl  label  such  as  **Language"  which  does  not  Indlcste  vhlch 
language*    An  additional  complication  In  bilingual  education  Is  that  dif- 
ferent groups  may  hove  different  schedules*  and  the  same  group  may  have 
s  different  schedule  of  language  study  at  the  beginning  and  at  the  end  of 
the  year.    Iflille  both  these  possibilities  are  mentioned  In  some  of  the 
PlPe*  the  sample  schedules  offer  no  help  with  these  two  areas.    A  simple 
schedule  could  be  produced  by  even  an  Inexperienced  staff*  and  It  Is  vlth 
some  of  the  complexities  of  scheduling  for  bilingual  Instruction  that 
additional  assistance  Is  required. 

2*4*3    Conclusions  (Scheduling) 

Xhe  PIP  developers  appsrently  did  not  Intend  for  sll  adopter  sites 
to  repllcste  the  Instructional  time  In  any  given  content  srea.  However* 
scheduling  Issues  that  are  peculiar  to  bilingual  Instruction  should  be 
discussed  In  greater  detail  In  order  for  this  section  to  be  useful  to 
adopters.    Grouping  Is  an  Important  aspect  of  the  bilingual  projects 
descrlbp.d*  but  specific  procedures  and  criteria  are  not  provided  by  the 
PIPs* 
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Table  C*l8 


Sample  Schedule  for  First  Grade 


Content  Areas 

Adelante 

Nuevos 
Horlzontes 

Savolr^ 

1.  6 
venceremos 

mln/day 

mln/day 

min/week 

mln/dav 

Language  Arts 
Enftlish 

30 

*ljr  O  LI  X  O  tl 

Gener  al 

503 

Readlnff 

a  u  ^  "-^o 

Enttllsli 

70 

50 

25-30 

1^1*  ATI  p1i 

S Danish 

45 

50 

60 

General 

Hath 

25^ 

60  J 

30 

Social  Studies 

30 

225 

20 /week 

Culture/her  it  af^e 

30 

Science 

15 

10/week 

Art 

20 

90 

20/veek 

Handwritine 

10 

15 

Health 

10 

Spelling 

15 

*7 

Husic 

20 

15 

30 

*8 

20 

20 

30 

1*  Language  arts  time  is  combined  with  reading  time* 

2*  Math  is  taught  in  English  Monday^  Wednesday*  Friday  and  in  Spanish 
on  Tuesday  and  Thursday* 

3*  For  language^  students  are  grouped  into  Spanish  monolingual^  English 
monolingual  and  bilingual* 

4*  Math  is  taught  in  same  language  on  alternaTe  days* 

5*  Grade  is  not  specified  for  the  Savior  schedule;  times  suggested  are 
for  the  French  curriculum*    District  schedule  is  followed  for  English 
curriculum* 

6*  Venceremos  offers  four  different  schedules  for  first  grade;  only  the 
the  first  one  is  included  here* 

7'  Spelling  is  included  in  English  language  arts* 

8*  Itisic  is  included  in  culture/heritage* 
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3.  MANAGEMENT 


3.1    Staff  Organization 

3.1.1  Staff  Membera  ^nd  Time  Commltmenta  (Table  C-19) 

Dlscuaeion.    The  ataff  membera  and  their  time  commitments,  aa  de- 
scribed In  the  PIP,  are  Xlated  In  Table  C-l9.    As  the  projects  expsnd, 

part*tlme  poaltlona  become  full~tlme  and»  In  the  Nuevoa  Horlzontea  and 

c 

Adalante  PlPa,  additional  Instructional  coordlnatora  are  added. 

Uaefulneas  to  adopters.    None  of  the  staffing  pattema  dlscuased  In 
this  aectlon  are  unique;  in  fact,  there  Is  a  high  degree  of  similarity 
among  the  atsffs  specified  In  the  four  PIPs.    However,  auch  llsta  are 
useful  to  project  directors  In  program  planning.    Slmllarltlea  in  ataff* 
Ing  patterns  reflect  standard  prsctlces  In  Title  VII  projects  at  the  time 
the  originating  sites  were  observed.    Since  that  time,  the  funding  of  a 
national  network  of  materials  development  centera  has  reduced  the  empha* 
sla  In  curriculum  development,  which  waa  a  large  part  of  the  Instructional 
conaultant's  role. 

Dlfferencea  among  staffing  patterna  probably  reflect  what  actually 
occurred  st  the  originating  sltest  and  do  not  seem  to  be  bssed  on  differ* 
ences  In  program  objectlvea. 

3.1.2  Organizational  Structure 

Dlacuaslon.    The  project  director  described  In  the  Adelante  and 
Nuevoa  Horlzotitea  PIPs  Is  a  strong  leader.    The  Venceremos  apd  Savolr  PIPs 
offer  a  more  democratic,  shared  declalon-maklng  model.    However,  Adelante 
and  Nuevos  Horlzontes  staff  alao  have  Input  Into  declsion*-maklttg .    In  t\\\ 
cases,  the  project  director  la  ultimately  responsible  for  the  project. 
The  thrive  Spanlsh*Engllah  PIPs  state  that  the  project  director  Is  housed 
In  the  dlatrlct  admlnlatratlon  office  thereby  conferring  a  dlatrlct  level 
status  to  the  poaltlon.    All  of  the  projecta  are  designed  to  be  located  In 
two  or  more  achools,  requiring  admlnlatratlve  coordination  between  schoola. 
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Table  C-19 


Project  Staff* 
(For  First  Year  of  Project) 


Position 

Adelante 

Huevos 
Horizon tes 

Savolr 

Venceremos 

Project  Director 

Full-time 

Full*tlme 

Full-time 

Full-time 

Instructional 
Coordinator/ 
Instructional 
Consultant** 

Full-time 

Full*  time 

Full-time 

Community  Coordinator 

Half-time 

Evaluator 

Half*tlme 

Half -time 

Full-time 

Half -time 

English  Curriculum 
Coordinator 

Full-time 

French  Specialist 

Half*tlme 

Secretary 

Full-time 

Full-time 

Full-t Ime 

*Some  variation  in  time  commitments  as  the  projects  expand  to  fourth 
grade* 

**The  terms  differ  but  the  position  is  the  same* 
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Usefulness  to  adopters.    The  structure  and  tone  of  an  organization 
have  a  lot  to  do  with  Its  effectiveness »  and  this  is  acknowledged  by 
careful  PIP  descriptions  of  what  Is  desired  In  this  area.    The  problem 
Is  that  certain  results  cannot  be  obtained  by  simply  providing  directions. 
The  types  of  organisation  established  by  adopters  depend  more  on  local 
policies  and  on  the  people  Involved  than  on  any  Instructions  given  In  a 
PlP^type  package. 

3.1.3  Qualifications  (Table  C-20) 

Discussion.    The  PIPs  provide  lists  of  qualifications  for  each  staff 
position.    Although  the  actual  positions  are  sl]nllar»  If  not  Identical* 
the  qualifications  stated  In  the  PIPs  differ.    A  selection  of  quallflca^ 
tlons  are  compared  In  Table  C-20. 

Usefulnesa  to  adopters.    With  few  exceptions,  the  different  qualifi- 
cations that  appear  la  each  PIP  do  not  reflect  differences  In  role  or 
responsibility.    They  probably  reflect  what  was  Important  to  originating 
site  personnel.    If  all  the  qualifications  listed  In  the  four  PIP3  were 
combined,  that  list  would  be  very  comprehensive  and,  as  such,  potentially 
helpful  to  project  planners.    The  qualifications  that  are  Included  In  all 
four  PlPa  are  optimal,  but  many  districts  wishing  to  adopt  bilingual  proj- 
ects cannot  match  such  qualifications.    In  order  to  have  model  projects 
that  are  widely  applicable,  some  recognition  of  these  difficulties  is 
essential* 

3.1.4  Selection  Procedures 

Discussion.    The  PIPs  call  for  the  district  to  hire  the  project  di- 
rector and  the  project  director  to  iiire  other  staff  in  accordance  to  PIP* 
specified  qualifications.    Guidelines  are  given  in  all  the  PIPs  about 
overall  staff  qualifications  and  about  achieving  a  balanced  staff.  The 
PIPs  also  state  that  local  hiring  policies  may  prevail. 
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Tabic  C-20 


A  Comparison  of  Selected  Staff  Qualifications 


A 

HH 

s 

V 

Project  Director 

Experienced  administrator 

X 

X 

X 

X 

Exi^rlenced  In  curriculum  materials  plannlnR 

X 

X 

Able  to  Plan  and  manaKe  budKet 

X 

Skilled  In  wrltlne  reports 

X 

Masters  degree  or  equivalent 

X 

X 

X 

Instructional  Consultants/Coordinators 
Successful  teachlne  experience 

X 

X 

X 

X 

Experience  In  uslnK  Performance  objectives 

X 

X 

Knowledgeable  about  goals  and  techniques  of 
bilingual  education 

X 

Eval  J tor 
Is  blllnKual 

X 

X 

X 

Teachers 
Are  blllnKual 

X* 

X 

X 

Have  blllnKual/blcultural  background 

X 

Teacher  Aides 
Are  hlsh  school  Kraduates 

X 

X 

A  »  Adelante;       ^  Huevos  Horlzontes;  S  -  Savoir;  V  »  Venceremos 


*Only  required  of  K*-2  teachers 
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Usefulness  to  adoptera*    As  anticipated  in  the  PIP  suggestions  them- 
selves »  discussion  of  selection  procedures  is  not  very  useful  because  dis- 
trict hiring  procedures  are  not  usually  amenable  to  change* 

3*1.5    Conclusions  (Staff  Organisation) 

The  portions  of  the  PIPs  that  describe  staff  organization  are  helpful 
at  the  level  of  program  planning*    Suggestions  about  staff  configurations 
are  probably  the  most  useful,  but  their  utility  would  he  increased  if  the 
different  PIPs  offered  a  real  choice  of  staffing  patterns*  Discussions 
of  staff  qualifications  aeem  to  vary  arbitrarily  across  the  pips  and  a 
compilation  of  all  the  four  PIPs  may  be  more  helpful  than  any  single  dis- 
cuasion*    Organization  structure  and  selection  procedures  are  usually 
firmly  established  by  each  district  and  are  not  subject  to  influence  by  a 
PIP. 
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3*2    Staff  Rolea 


Each  Pir  describes  the  various  staff  members'  roles  and  responsibil** 
i ties  4 

3*2*1    Project  Director  (Tables  C-21  and  C-22) 

Discussion*    The  role  and  responsibilities  of  the  project  director 
are  extensively  described  in  the  Project  MansRement  Directory  which  is 
designed  to  be  a  guide  for  running  the  project*    The  project  director's 
major  tasks  are  very  similar  across  the  four  PIPs*    The  project  director's 
role  is  the  most  complex  and  is  discussed  here  by  area  of  responsibility, 
following  the  categories  of  Table  C**21* 

#  Style  of  leadership:    See  discussion  of  organizational  structure. 
Section  3*1*2* 

e     Funds  and  budgeti    All  four  PIPs  devote  an  entire  chapter  to  the 
budget*    A  packet  of  five  worksheets  tailored  to  each  project  is 
provided  with  accompanying  explanationa*    A  combined  tabl2  of  con* 
teats  for  this  chapter  is  shown  in  Table  C**22*    As  shown  in  the 
table,  there  are  &cme  topics  that  are  treated  in  totally  parallel 
fashion  and  others  that  are  treated  only  in  one  PIP* 

•  Public  relations;    Communication  is  one  of  the  constant  themes 
throughout  all  four  PIPs*    The  Project  Management  Directory  of 
each  PIP  has  one  chapter  entitled  "Communicating  with  School  and 
Community"  and  another  one  entitled  '*Staff  Relationships*"  Al- 
though the  individual  recommendations  may  be  worded  slightly 
differently,  the  message  is  similar*    In  addition  to  the  m^ijor 
tasks  listed  in  Table  C**21,  the  project  director  is  given  general 
goals,  such  as  a  high  staff  morale,  cooperative  relationships 
among  all  staff  members,  and  the  absence  of  ±v9olubl&  conflicts* 
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Table  C*21 


Hole  of  Project  Director 
(As  Defined  by  Major  Tasks) 


A 

NH 

s 

V 

Funds  and  Budgets 
•  seek  funding  for  second-year  continuation 

X 

X 

X 

X 

Public  Relations 

•  Involve  the  parents  and  community  In  the 
project 

•  maintain  the  Interest  of  the  school  board 
and  district  officials  In  the  project 

•  orient  school  and  community  to  the  project 

X 
X 
X 

X 
X 
X 

X 
X 
X 

X 
X 
X 

Administration 

•  plan  the  second  year 

•  supervise  the  planning  of  evaluation 

•  arrange  for  rooms  and  other  facilities 

•  supervise  selection  of  target  schools  and 
students 

X 
X 
X 
X 

X 
X 
X 
X 

X 
X 
X 
X 

X 
X 
X 
X 

Overseeltig  Instruction 

•  monitor  Instruction 

•  work  with  English  curriculum  coordinator 
and  French  specialist  tc  review  performance 
objectives 

X 

X 

X 
X 

X 

Staff  Training 

•  supervise  the  planning  and  implementation 
of  monthly  in-service  training 

•  prepare  and  supervise  a  start-up  workshop 
for  staff 

X 

X 
X 

X 

X 

Developing  and  Ordering  Materials 
•  work  with  staff  to  select  and  order 
materials 

X 

X 

X 

X 

Staff  Recruiting  and  Training 
•  recruit  and  select  project  staff 

X 

X 

X 

X 

A  "  Adelante;  NH  "  Nuevos  Horlzontes;  S  ■>  Savoir;  V  "  Vencereutos 
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Table  C-22 


Comparative  Table  of  Contenta  for  the  BudRet 
Chapter  of  the  PMD 


Project  Goals 

4 

Project  Director's  Tasks 

4 

Budgeting  Issues 

Sample  Schedule  of  Expenditures 

A. 
V 

S,  V 

IrtujcCL   UOS  tS 

Start-up  Costs 
Lionc  xnua  c  ion  uos  c  s 

 /  

A 

A 

uos  c  ifU  ide  11  nes  ^ 

Sample  Schedule  of  Expenditures 

nn 
HH 

Budgeting  Procedures 

NH 

Adapting  Costs  to  Local  Conditions 

Planning  for  First  Year  New  Students 
Planning  for  Expansion 
Sample  Schedule  of  Expend ltures» 
Exclusive  of  Salaries 

A, 
A, 
A, 
A, 

S,  V 
V 
V 
S 

Planning  the  Second  Year 

A 

Alternative  Configurations 

A 

Budget  Worksheets 

Staff  Costs  (Worksheet  1} 

Facilities  (Worksheet  2) 

Equipment /Materials 

Equipment  (Worksheet  3) 

Materials  (Worksheet  4) 

Locally  Developed  Materials  (Worksheet  4) 

Total/Costs  (Worksheet  5} 

4 
4 
4 
4 
4 
4 
4 
4 

4  «  Item  appears  In  all  four  PIPs 
A  "  Adelante 

HH  «  Nuevos  Horlzontes 

5  «  Savolr 

V  «  Venceremos 


•  Administration:    Aljoost  everything  discussed  In  the  PMDs  could 
fall  under  this  category,  but  items  mentioned  here  are  those 
not  Included  In  other  discussions  of  project  director  responsl*^ 
bllltles* 

•  Overseeing  Instruction;    Direct  responsibility  for  this  tesia  ^& 
delegated  In  all  the  PIPs  to  the  Instructional  coordinators,  but 
the  project  director  Is  ultlioately  responsible  for  this  area* 

•  Supervise  monthly*lnservlce  tralnlnR!  More  detailed  PIP  content 
In  this  area  will  be  dlsc^  3sed  under  "staff  Development"  Section 
3.3. 

•  Developing  and  orderlng_materlals:    Detailed  lists  of  materials 
are  provided  In  the  PIPs  and  are  discussed  In  Section  2*2*7* 
General  procedures  are  also  provided  In  some  PIPs,  such  as 
setting  up  a  syst^  for  checking  out  materials* 

•  Staff  recruiting  and  hiring;    The  ?MD  of  each  PIP  has  a  chapter 
devoted  to  staff  selection*    Staff  qualifications  are  listed  for 
each  position  discussed  In  the  PIP*    A  general  section  entitled 
"Adapting  to  Local  Conditions*'  describes  minimal  qualifications 
for  the  staff  as  a  whole*    Three  of  the  PIPs  state  that  local 
policies  may  Influence  hiring  of  staff*    All  the  PIPs  express  a 
preference  for  teachers  who  volunteer  to  be  In  the  program  and 
staff  who  are  already  working  In  the  district* 

Usefulness  to  adopters*    The  project  director  Is  the  staff  person 
whose  role  Is  described  In  most  detail*    Task  lists  are  given  for  each 
chapter  In  the  PMD,  and  a  calendar  Is  provided  showing  when  each  task 
should  be  done*    There  Is  considerable  general  discussion  about  project 
management  and  many  desired  goals  or  outcomes  are  defined*    For  an  Inex- 
perienced project  director^  the  PMD  would  be  fairly  useful  In  planning 
and  starting  a  project*    It  would  be  difficult  for  anyone  to  follow  the 
PMD  like  a  rule  book  because  districts  also  play  a  part  In  the  roles  and 
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responsibilities  assigned  to  directors.    Nevertheless,  even  for  sn  experi- 
enced project  director  the  PHD  could  serve  ss  s  useful  checklist.    The  FMD 
does  not  offer  any  unique  spprosches.    However,  the  sttempt  to  orgsnlze  a 
project  management  handbook  may  be  unique  and  valuable  In  Itself. 

3.2.2  Teachera  (Table  C-23) 

Dlscuaalon.    The  function  and  role  of  the  teachera  la  not  appre  ,lably 
different  acroaa  the  four  PIPa.    (Table  C-23  comparea  the  rolea  of  teachera 
anc!  other  peraonnel.)    A  poaalble  exception  may  be  Savolr  where  literacy 
la  taught  flrat  In  English,  and  the  target  population  may  be  already  bi- 
lingual.   An  apparent  difference  la  the  importance  given  to  cooperative 
teaching  In  the  Adelante  PIP.    Teachera  group  atudenta  acroaa  gradea  and 
claaaea  and  plan  cooperatively,  ao  all  atudenta  are  In  the  moat  appropri- 
ate group.    However,  In  a  lesa  emphatic  way  the  Nuevoa  Horlzontes  atid 
Venceremoa  auggest  the  aame  thing,  so  the  difference  may  only  be  one  of 
emphasis* 

Uaefulneas  to  adoptera.    The  teachera'  manual,  which  follows  the  aame 
general  fotrmat  aa  the  PMDa,  waa  not  nearly  aa  useful  In  the  field  tryout. 
Thla  may  be  becauae  teachers  are  more  Intereated  In  Inatructlonal  guldea, 
materlala,  curriculum,  and  objectlvea,  and  do  not  have  the  Intereat  or 
time  to  read  general  worka  on  their  role.    The  deacrlptlon  of  teachers' 
rolea  was  of  uae,  undoubtedly,  to  the  Inatructlonal  conaultanta.  However, 
clarification  of  role  dlfferencea  for  different  projects  or  a  alngle  defi- 
nition would  be  dealrable. 

3.2.3  Aides  (Table  C-23) 

Dlacusalon.    Aides  are  an  Important  component  of  bilingual  Inatruc- 
tlon  mid  may  represent  one  of  the  major  changea  brought  about  by  the 
bilingual  program.    The  rolea  of  the  aides  aa  described  In  the  PIPa  show 
dlfferencea  which  are  aot  related  to  different  program  goala.    The  pro- 
portion of  aldea  to  teachera  doea  vary,  aa  can  be  aeen  In  Table  C-15,  but 
the  variation  does  not  appear  to  be  related  to  the  aldea'  function,  and 
therefore  seema  arbitrary. 
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Table  C-23 


A  Selecclve  Comparison  of  Rolea  of  Other  Personnel 


A 

NH 

s 

V 

Teachers 

•  conduct  bilingual  classroom  instruction 

X 

X 

X 

X 

•  develop  ani  use  performance  objectives 

X 

X 

X 

•  provide  a  maximum  of  individualized 

X 

X 

instruction 

•  develop  and  administer  mastery  tests 

X 

X 

•  develop  instructional  materials 

X 

X 

Teacher  Aides 

•  assist  in  classroom  instruction 

X 

X 

•  tutor  individual  students 

X 

X 

X 

X 

•  help  prepare  and  reproduce  teaching 

X 

X 

materials 

•  help  check  students'  work  and  maintain 

X 

X 

X 

a tu dents'  records 

•  reinforce  the  activity  Just  taught 

X 

Ins true tonal  Coordinator/Consultant 

•  plan  and  conduct  training  programs 

X 

X 

X 

X 

•  coordinate  parent  involvement  activities 

X 

X 

•  observe  teachers  and  provide  technical 

X 

X 

X 

assistance 

•  coordinate  curriculum  development 

X 

X 

X 

•  assist  with  the  transition  from  Spaniah 

X 

X 

to  Spanish  and  English 

Evaluator 

•  develop  and  implement  evaluation  design 

X 

X 

X 

X 

•  prepare  evaluation  reports 

X 

X 

X 

X 

•  monitor  project  Implementation 

X 

X 

X 

X 

•  assess  progress  on  objectives 

X 

X 

X 

X 

A  ■  Adelance;  NH  ■  Nuevos  HorlzonCea;  S  ■  Savolr;  V  ■  Venceremos 
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Usefulness  to  adopters.  Descriptions  of  the  aides'"  roles  could  have 
shown  more  consistency  across  the  PlPs  or  could  have  represented  program- 
matic differences. 

3.2.4  OtheiL  staff  (Table  C*23) 

Discussion.    The  four  PIPs  have  slightly  different  staff  configura- 
tions»  f^nd  the  roles  reflect  that.    For  example^  Nuevos  Horisontes  has  a 
parent  coordinator*  while  in  other  projects  that  role  is  assigned  to  the 
instructional  consultant.    The  role  of  the  evaluator*  as  described  in  the 
evaluator'^s  manual^  xb  identical  across  the  four  PIPs. 

Usefulness  to  adopters.  The  instructional  coordinator*  community  co- 
ordinator* and  evaluator  wesce  each  provided  with  a  PIP  loanual  of  their  own 
Their  roles  were  thus  defined  for  them»  as  well  as  for  other  project  staff 
such  as  the  director*  Assuming  that  the  role»  as  described  in  the  PXP^  is 
congruent  with  the  role  of  the  corresponding  staff  member  in  an  adopting 
site»  it  is  very  useful  for  staff  members  to  have  a  clear  understanding  of 
their  role. 

3.2.5  Conclusions  (Staff  Roles) 

The  definition  of  staff  meniber  roles  ^nd  responsibilities  is  one  of 
the  most  useful  contributions  of  the  PIPs.    A  person  with  no  experience 
in  bilingual  projects  would  undoubtedly  find  the  detailed  Job  descriptions 
useful.    Possibly^  the  selection  of  a  good  staff  and  a  clear  definition  of 
areas  of  responsibility  vould  solve  many  aspects  of  project  Implementation 

When  the  discussions  of  staff  roles  are  compared  across  the  PXPs» 
the  cifferences  between  them  appear  arbitrary*  and  any  one  is  probably  as 
helpful  as  the  next.    In  addition  even  general  guidelines^  such  as  staff 
configurations »  are  subject  to  change  over  time.    Requirements  for  evalu- 
ation change  with  the  legislatures.    Materials  development  may  be  impor- 
tant at  one  pointy  and  five  years  later  it  may  be  unnecessary.  Finally^ 
the  PIPs  do  not  truly  consider  context.    The  decision  makers  in  a  district 
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would  h&ve  to  accept  &nd  authorize  the  PIP  roles  In  order  for  them  to  work. 
This  m&kes  the  PIP  still  useful  bb  b  reference^  but  not  &&  a  &tep-by*-&tep 
instruction  book* 
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3.3    Staff  Development 


3*3*1   Heeds  AsBeBBinent 

PlBCUBBlon.    None  of  the  PIPb  directly  dlBCUBB  aBBeBBing  existing 
staff  skills.    The  PIPs  do  suggest  that  staff  be  given  the  opportunity 
to  evaluate  the  project  in-service  sessions  and  to  make  suggestions  for 
£ut:ure  workshops. 

UsefulnesB  to  adopters.    Heeds  assessment  is  not  treated  in  the  PIPs; 
its  absence  may  affect  the  usefulness  of  other  sections. 

3.3.2  Structure  of  Training  (Table  C-24) 

Piacussion.    Detailed  schedules  of  topics  are  provided  for  the  starts 
up  workshop.    The  schedule  in  the  Savoir  PIP  is  particularly  complete  and 
provides  goals  for  each  workshop  activity.    However»  workshop  content  is  not 
discussed  in  detail.    In  many  casss»  the  PIPs  suggest  finding  a  consultant 
to  teach  a  topic.    Thus»  adopter^site  workshops  may  differ  substantially 
from  those  in  the  originating  sites.    Treatment  of  in-service  workshops 
and  other  staff  development  activities  is  even  more  general  and  varies 
across  the  PIPs  (see  Table  C-24  for  a  summary). 

Usefulness  to  adopters.    The  provision  of  a  complete  start-up  work* 
shop  schedule  is  very  useful  to  inexperienced  project  directors.    Even  if 
adopting  districts  judge  that  certain  sections  of  the  workshop  are  not 
needed^  it  may       easier  to  revise  the  existing  plan  than  to  create  a  new 
one. 

3.3.3  Characteristics  of  Training 

Discussion.    Hone  of  the  PIPs  discups  modifying  in-service  sessions 
according  to  teacher  experience.    Only  Venceremos  specifically  states  that 
aides  and  teachers  should  occasionally  be  offered  separate  training.  Many 
opportunities  are  provided  the  teachers  and  aides  (e.g.^  in  the  start-up 
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Table  C-24 


Staff  Development 


Adelante 

Kuevos 
Hoirizontes 

t 

Savoir 

Venceremos 

Level  of  detail 
provided  oa  start- 
up workshop 
schedule 

Hourly 
Schedule 

Hourly 
Schedule 

Hourly 
Schedule 

Hourly 
Schedule 

Level  of  detail  on 
Inservlce  workshops 

Topics  suggest- 
ed} one  saniple 
plan  provided- 

Topics  and  for- 
mat sufiizested* 

Topics 
suffAes  ted  • 

Topics  suggest- 
ed; one  sample 
plan  provided. 

Other  staff  devel- 
opment  activities 

University  Courses 

X 

X 

District  Inservice 

X 

X 

Conferences 

X 

Visits  to  other 

X 

X 

X 

X 

^  A  ji  ^  h  A  1*0 

X  C  ^  U  A  X  cu 

01 1  ff  ffd^O  ^  <k 

01 1  ff  ff <k  e 

Allies  fATAlVA 

separate  inservice 

X 

Mon-project  staff 
incl^ided  in  startup 
or  inservice  work* 
shops: 
Teachers 

X 

X 

Principals 

X 

X 

Parents 

X 

District  Personnel 

X 

workshop^}  to  teach  model  lessons,  plan  together,  or  loake  materials.  The 
Adelante  PIP  suggests  that  about  half  of  the  workshop  time  should  be  de- 
voted to  ^'hands-on**  activities.    In  addition,  all  the  PIPs  state  that 
teachers  should  suggest  topics  for  future  in-service  workshops.  Adelante 
and  Savoir  mention  that  teachers  and  aides  should  be  encouraged  to  pursue 
credit  courses,  and  Venceremos  and  Huevos  Horizontes  mention  making  use 
of  available  district  workshops. 

Usefulness  to  adopters.    The  greatest  weakness  of  the  staff  develop- 
ment program  discussed  in  the  PIP  is  that  no  distinction  is  made  between 
audiences  with  potentially  very  different  training  needs  such  as  (1)  ex- 
perienced bilingual  teachers  and  inexperienced  teachers,  (2)  fluent  Span- 
ish or  French  speakers  and  persons  who  need  additional  language  skills, 
and  (3)  teachers  and  aides.    The  type  of  training  suggested  is  practical 
and  user-oriented.    The  information  provided  in  the  four  PIPs  collectively 
about  university  courses  and  other  sourcc^s  of  training  is  fairly  compre- 
hensive, but  no  one  PIP  has  all  of  the  information. 

3.3.4  Audiences 

Discussion.    Staff  development,  as  discussed  in  the  PIP,  includes 
only  teachers  and  aides,  not  the  director  and  project  support  staff. 
Hon-project  staff  invited  to  workshops  is  summarized  in  Table  C-24. 

Usefulness  to  adopters.    It  would  be  more  helpful  to  adopting'  dis- 
tricts to  differentiate  the  audience  for  staff  development  according  to 
need,  skills,  and  role.    The  PIPs  do  provide  useful  reminders  to  include 
non-project  staff  in  training  activities,  but  the  suggestions  of  who  to 
include  vary  across  the  PIPs  without  apparent  reason. 

3.3.5  Conclusiona  (Staff  Development) 

Staff  development  is  a  major  component  of  bilingual  education  and 
justifiably  receives  a  large  amount  of  attention  in  the  PIPs.  Enough 
detail  on  topics  is  provided,  at  least  for  the  start-up  workshop,  to  be 
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quite  useful  to  project  directors.    However »  the  specific  contents  and 
procedures  of  training  must  be  determined  by  the  adopter-site.    The  PIPs 
do  not  consider  the  diverse  training  needs  of  the  staff. 
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3.4    Parents  and  Community 


3.4.1    Parent  Involvement  In  School  Affalra  (Table  C-25) 

Discussion.    All  the  orlglnstlng  sites  were  subject  to  the  same  re* 
qulrements  to  Involve  parents  in  project  activities.    However*  the  activ- 
ities described  varied  across  the  PIPs.    For  examplei  parents  clearly 
assist  In  the  classroom  only  In  Adelante  and  Savolr.    Table  C-25  Is  a 
summary  of  the  parent  Involvement  component  described  In  each  PIP. 

Usefulness  to  adopters.    The  usefulness  of  this  section  depends  on 
which  PIP  Is  discussed.    Venceremos  has  very  little  on  parent  Involvement^ 
Adelante  has  somewhat  more,  and  Savolr  and  Nuevos  Horlzontes  have  the  most 
complete  coverage.    An  apparent  difference  Is  that  Venceremos  does  not 
Involve  parents  In  the  classroom  While  the  other  PIPs  do,  but  since  this 
Is  not  explicitly  stated  the  reader  Is  not  sure  If  this  Is  a  real  differ* 
ence  or  simply  a  difference  In  the  description. 

Even  within  a  single  PIP,  differences  In  level  of  detail  exist  for 
the  activities  discussed.    Savolr  provides  a  useful  example  of  a  parent 
survey,  for  example,  but  does  not  give  very  much  Information  about  how  a 
program  of  parents  volunteering  In  the  classroom  could  be  organized. 

Some  of  the  Ideas  presented  are  discussed  In  enough  detail  to  be  use- 
ful to  a  project  director.    It  would  be  helpful  if  the  PIPs  distinguished 
between  minimum  requirements  of  a  parent  Involvement  component  such  as 
Information  meetings,  and  "extras"  such  as  a  toy-lending  library. 
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Table  C-25 


Parent  Involvement 


A 

1  NH 

S 

V 

Project  staff  member  in  charge 
of  parent  involvement;  %  in 
first  year 

50Z  of 
Instructional 
Consultant 

Half-time 
Community 
Coordinator 

Time  Unspeci- 
fied; English 
Curriculum 
Coordinator 

Time  &  Person 
Unclear; 
probably  the 
Prolect  Director 

Activities  for  parents: 
Parents  visit  classroom 

K 

1    Special  events 

X 

[    Toy  lendinK  library 

X 

1   Boom  at  school  for  use 
by  Parents 

X 

1    Assisting  in  the  class-* 
room 

K 

Optional 

X 

Library  aides 

X 

Tutorlne 

X 

Chaperoning^ field  trlPs 

X 

Workshops^  meetinKs 

K 

K 

X 

Classes 

Communication  with  parents: 
Brochure 

K 

Newsletter 

K 

X 

X 

Letters 

X 

Local  media  coveraj^e 

K 

K 

1  ?  

Parent  teacher  conferences 

X 

X 

Teachers  telephone  parents 
or  write 

K 

Home  visits  by  staff 

K 

'  Survey  of  parents 

K 

X 

A  »  Adelante;  KH  *  Kuevos  Horizontes;  S  «  Savoir;  V  *  Venceremos 


3.4.2    Community  Input  (Table  C-26) 


Discussion.    The  role  and  organization  of  the  Parent  Advisory  Council 
(PAC)  for  each  PIP  Is  Illustrated  In  Table  C-26.    As  can  be  seen  from  the 
table^  there  Is  considerable  variation  In  what  l6  said  about  the  PAC  In 
the  different  PIPs. 

Usefulness  to  adopters.    Several  plans  for  organizing  parent  advisory 
councils  and  holding  meetings  are  represented  among  the  PIPs.  Because 
some  plans  are  discussed  In  greater  detail  than  others »  some  differences 
may  be  due  to  the  PIP  descriptions  and  not  to  the  origination  site  prac* 
tlces.    As  with  the  parent  Involvement  component »  this  section  would  be 
more  useful  If  It  clearly  distinguished  basic  tasks  of  the  PAC  from  de- 
sirable extras.    The  Venceremos  PIP  seems  particularly  Incomplete  In  list- 
ing as  the  only  task  for  Its  PAC  the  Initiation  of  media  coverage  of  the 
project.    Current  legislation  mandates  how  PAC  members  are  chosen  for 
Title  VII  projects  causing  PIP  recommendations  to  be  obsolete. 

3.4.3    Community  Support 

Discussion.    All  of  the  PIPs  discuss  the  importance  of  developing 
community  support  and  the  role  that  this  support  can  play  In  the  con- 
tinued life  of  the  project.    The  principal  means  of  developing  support 
Is  through  communication^  which  Is  discussed  In  the  Section  3.5.3. 

Usefulness  to  adopters.    To  be  discussed  In  communications  section. 

3*4.4    Parent  Education 

Discussion.    Parent  education  receives  little  more  than  a  mention  In 
most  of  the  PIPs.    Workshops  are  organized  for  parents^  Information  meet- 
ings are  held»  and  parents  are  Invited  to  Inservlce  (see  Table  C-25).  The 
most  complete  coverage  Is  provided  ^y  Savolr^  where  Information  needed  by 
parents  and  reasons  for  negative  attitudes  are  discussed  In  detail. 
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Table  C-26 


Parent  Advleory  Council  (PAC) 


Adelante 

thievos 
Horizontes 

Savolr 

Venceremos 

How  organized 

District  PAC 

One  PAC  per 

op  no n 1  find 

district  PAC 

One  PAC  per 
school  And 

district  PAC 

District  PAC 

Meetings 

At  least  three 
time  a  year 

School:  monthly 
District:  saol- 
monthly 

Once  a  month 

Every  6  weelcB 

Ac^tivltiea  of  PAP* 
Sponsors  events 
for  parc^nts 

X 

needs*  attitudes 

X 

inxcxace  meuxa 
caveraae 

X 

jraTcxcxpaces  xn 
project  needs 
assessmenc 

* 

y 

Consulted  about 
changes  for  fol* 
lowinK  year 

X 

Organized  Into 
study  teams 

X 

Consulted  about 
 staff  development 

X 

X 

How  PAC  members  are 
chosen 

Appointed  by 
Project  Director 

Unclear 

Appointed  by 
Project  Director 

Unclear 

Staff  and  non* 
parents  who  meet 
with  PAC 

Instructional 
Consultant) 
Project  Director 

ComiQunlty 
Leader »  Bi- 
lingual 

education 
teacher » 
principal 

Project  Dire c tor » 
Curriculum  Coor- 
dlnator»  Repre* 
aentatlves  from 
FTA»  business  1 

education 1 
clergy»  one  high 
school  student 

Representatives 
from  local 
community 
agenclea 
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Usefulness  Co  adopters*  The  PIP  creacment  of  parent  education  con*- 
slscs  primarily  of  a  reminder  Co  Include  parents  rather  than  Information 
about  how  this  should  be  done*  ihe  Savolr  discussion  of  possible  parent 
attitudes  Is  helpful  to  an  Inexperienced  project  director* 

3*4*5    Parent  Conferences/Counsellna 

Discussion*    Two  of  che  PIPs  mention  parent  teacher  conferences  and 
tvo  require  home  visits*    No  specific  Information  Is  given  other  than  the 
requirement  to  maintain  open  channels  of  communication* 

Usefulness  to  adopters*    The  PIPs  contain  little  Information  on  this 
subject  * 

3*4*5    Conclusions  (Parents  and  Community) 

Parent  and  community  Involvement  Is  a  major  requirement  of  Title  VII 
bilingual  projects*  and  therefore*  this  topic  deserves  attention  In  the 
PIPs*    The  treatment  of  chls  topic  Is  of  uneven  quality*    In  some  PIPs 
detailed  procedures  are  provided*  but  In  others  the  topic  Is  discussed 
too  superficially  to  be  helpful*    Although  different  approaches  to  parent 
Involvement  are  probably  warranted  In  different  situations*  the  differences 
among  the  PIPs  do  not  seem  related  to  other  program  goals*    Therefore*  It 
s&ems  unlikely  that  a  district  that  liked  the  Nuevos  Horlzontes  staffing 
pattern  would  also  want  to  provide  exactly  the  same  parent  component  de- 
scribed In  Nuevos  Horlzontes*    A  summary  of  certain  basic  choices*  and  a 
list  of  desirable  "extras'*  would  be  more  helpful  to  Inexperienced  project 
directors  than  the  present  system* 
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3.5  ^^filin^c^t^iop 
3.5.1    Staff  Relations  (Table  C-27) 

Discussion.    A  chapter  entitled  "Staff  Relationships"  appears  In  all 
four  PIPs  with  very  minor  changes.    For  Illustration*  a  selection  of  the 
major  points  of  this  chapter  appear  In  Table  C»27.    As  can  be  seen  from 
the  table»  most  of  the  Items  describe  general  desired  outcomes*  rather 
than  procedures  for  accomplishing  them. 

Usefulness  to  adopters.    As  a  general  statement  of  the  kind  of  staff 
relations  desired*  the  PIP  chapter  on  this  subject  Is  useful.  However* 
t!m  chapter  Is  not  Intended  to  serve  as  a  guide  to  creating  such  relation** 
shl^s.    Certainly*  If  there  were  serious  problems  In  staff  relationships* 
the  advice  In  the  PlPa  would  be  of  little  use. 
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Table  C-27 
Selected  Directives  for  Staff  Relations 


(For  All  PIPS  Unless  Otherwise  Labeled) 


Goals 

Staff  morale  Is  high 

No  In&oluble  conflicts  arise  among  project  staff 
Staff  share  In  decision-making  (Nuevos  Horlzontes  only) 
Coop<;;ratlve  relationships  exist  among  all  staff  members 
Authoritarian  postures  are  discouraged  (Savolr  only) 

Prolect  Director  and  Instructional  Staff 

Director  makes  a  point  to  ask  for  teachers'  and  aides'  Ideas 

Project  Director  and  Won-Instructlonal  Staff 

The  staff  whose  roles  overlap  (PD  and  IC  or  PD  and  CC)  should 
develop  a  good  working  relationship 

Tha  project  director  and  the  evaluator  should  agree  on  a  well** 
defined  plan  and  procedure  for  reporting  negative  findings  if 
they  should  occur 

Relationship  Among  Staff 

Teachers  supervise  aides  but  this  supervision  should  not  be 
exercised  In  a  manner  that  detracts  from  cooperation  in  the 
classroom 
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3*5*2    Relations  with  Hon-Froiect  Staff  (Table  C-28) 


Discussion*    Developing  relations  with  non*project  staff  consists^ 
principally,  In  communicating  with  all  staff  who  can  affect  the  project 
or  who  are  affected  by  It*    Each  PIP  has  a  chapter  on  public  relations 
entitled  "Communicating  with  School  and  Community,"  the  content  of  which 
la  summarised  In  Table  C-28* 

Usefulness  to  adopters*    PIP  explanatlona  about  communicating  with 
non*project  staff  are  concrete  and  therefore  helpful  to  an  Inexperienced 
project  director*    The  Information  provided  collectively  In  the  PIPs  Is 
ccmprehenslve,  but  Individual  PIPs  differ  for  apparently  arbitrary  reasons* 
For  example,  the  pMDs  of  three  of  the  PIPs  give  a  list  of  Instructions  for 
Involving  the  principals,  but  Adelante  does  not*  Considering  the  Important 
role  of  the  principal  In  project  schoola^  thla  Is  more  likely  to  be  an 
overalght  than  a  project  difference* 

3*5*3    Dlaaemlnatlon  of  Project  Information  (Tables  C-25  and  C--28) 

Discussion*    The  eventual  success  or  failure  of  a  project  may  depend 
lesa  on  Intrlnalc  project  qualities  than  on  how  the  project  Is  perceived 
by  the  school  and  by  the  community*    The  PlPa  recognise  this  principle  and 
Strega  the  need  to  build  and  maintain  aupport*    The  PlPa  Include  oi;lenta* 
tlon  materlala  (posters,  brochures,  and  a  slide/tape  presentation,  avails- 
able,  unfortunately.  In  English  only)  to  facilitate  presentatlona  about 
the  project*    Table  C*25  summarlzea  the  auggeatlona  In  the  varloua  PIPs 
for  conveying  project  Information  to  parents*    Some  of  theae  techniques 
auch  as  local  medja  coverage  or  a  pro^-ject  newsletter  are  not  limited  only 
to  parents^  but  extend  to  the  wider  community  as  well*    Table  C*28  sum* 
marines  PIP  directives  for  Informing  the  varloua  achool  audiences  about 
the  project* 

Usefulness  to  adopters*    Collectively  the  four  PIPs  provide  a  good 
source  of  suggestions  for  disseminating  Information*    The  orientation 
materials  themselves  were  not  popular  with  field  test  altes;  perhaps 
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Table  C-28 
Communication  with  Hon-project  Staff 


A 

m 

s 

V 

District  aaministrators 
Orientation  meeting 

X 

X 

X 

Involve  district  currlctilum  coordinator 

X 

X 

Keen  lnf9rmed  throufthout  Proiect 

X 

X 

X 

Principals 

Orientation  meeting 

X 

X 

X 

Understand  reasons  principals  may  be  negative 

X 

V 

V 

V 

Keep  inionneQ  t  nrouKnout  proiect 

A 

A 

A 

involve  principals  in  oecxsions 

Y 
A 

Y 
A 

tvespecc  roie  axiierence  oi  ru  ana  principal 

Y 
A 

Involve  In  proiect  events 

X 

Non**proJec t  teachers 
Orientation  meetlnft 

X 

'  ■ 

V 
A 

Project  teachers  share  materials,  equipment, 
and  methods 

X 

X 

X 

X 

Proiect  director  meeta  with  school  ataff 

X 

Invite  to  staff  development  workahops 

X 

X 

School  Board 
Orientation  meetlne 

X 

X 

X 

Show  atudents  In  action 

X 

X 

X 

X 

Provide  costs  and  results 

X 

X 

X 

X 

Keep  bocrd  Informed 

X 

X 

x_ 

A  •  Adelante;  MH  -  Nuevos  Horlzontes;  S  -  Savolr;  V  •  Venceremos 
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adopter  sites  would  rather  have  posters  and  pictures  of  their  ovn  project 
than  of  the  originating  site. 

3.5.4    Conclusions  (Communication) 

Communication  and  staff  relations  are  given  great  importance  in  the 
PIP  management  system.    They  may  be  the  invisible  element  that  causes  a 
successful  project  to  run  smoothly  and»  without  which»  a  project  will  fail. 
To  attempt  to  give  instructions  for  successful  staff  relations  is  a  very 
ambitious  task  and  may  be  beyond  the  scope  of  any  packaged  program.  Gen- 
eral goals  for  staff  interaction  can  only  be  goals:    the  rest  depends  on 
the  individuals  involved.    In  order  to  obtain  improvements,  management 
training  or  some  sort  of  staff  workshop  may  be  needed. 

The  PIP  discussion  of  communication  is  helpful  to  an  inexperienced 
project  director.    However,  the  information  provided  by  a  compilation  of 
the  four  PIPs  would  be  more  complete  and  useful  than  that  provided  by  any 
individual  PIP. 
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3*6  Evaluation 

3*6*1    Strategies  for  Implementing  Project  Evaluation 

Discussion  (Table  029)*    Each  Pip  has  an  evaluation  manual  which, 
except  for  Introductory  material  specific  to  each  PIP,  Is  essentially  the 
same*    The  PIP  manuals  do  not  call  for  a  replication  of  the  original  site 
evaluation*    Instead  there  Is  a  discussion  of  various  Issues  and  choices 
evaluators  face  In  planning  and  Implementing  an  evaluation*    Table  C*29 
Is  an  outline  of  that  discussion* 

Usefulness  to  adopters*    The  problems  faced  by  evaluators  of  bllln* 
gual  education  projects  are  numerous,  and  providing  helpful  Information 
Is  a  challenging  task*    Many  of  the  directives  contained  In  the  evaluation 
manual  are  helpful,  but  the  major  problems  are  establishing  a  no-treatment 
expectation  and  finding  adequate  tests,  especially  In  the  non-English  lan- 
guage*   The  PIP  manuals  do  not  recognize  the  difficulty  of  these  two  tasks, 
which  In  the  field  experience  occupleu  a  disproportionate  amount  of  evalu- 
ators' time  and  frequently  proved  to  be  Insurmountable  problems*    Much  more 
detailed  Information,  even  for  the  less  complex  tasks,  would  be  necessary 
for  an  Inexperienced  evlauator,  but  other  publications  exist  for  this 
purpose  and  the  PIP  does  provide  some  references* 

3*6*2    Conclusions  (Evaluation) 

Although  the  orlglnating*-slte  evaluation  plans  and  results  are  pro^ 
vlded,  the  PIPs  do  not  encourage  replication  of  these  evaluations*  The 
evaluation  manuals  alert  the  reader  to  general  problems  In  bilingual  edu- 
cation evaluation*    However,  the  field  experience  showed  that  much  more 
assistance  Is  needed  In  this  area* 
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Table  C«29 

Strat&RleB  for  PlaimlnR  and  AccomPllshlnR  Project  Evaluation 


1*    AsBeaalniE  Project  Impact 

•  comparison  la  essential  In  eatabllahlng  a  no-treatmant 
expectation 

~use  norm-referenced  teats  If  appropriate 

~use  local  comparison  group  if  available 

^comparison  alao  posalble  with  other  bilingual  program* 

•  student  selection 

~aame  test  cannot  be  used  for  selection  and  evaluation 
~evaluator  should  be  Involved  In  selection 
'—method  of  selection  tuis  evaluation  implications 
»at  least  two  classes  are  necessary  per  grade  level  to 
counterbalance  teacher  dlfferencea* 

s     achievement  testing 

~need  to  measure  improvement  In  English »  non-English  lan- 

guage^  and  content  areas 
—outcomes  should  be  separated  for  students  In  different 

language  dominance  groups 
—standardized  tests  must  be  used  In  norm-referenced  models 

but  criterion-referenced  tests  may  be  used  in  comparison 

group  model 

—for  beginning  English  students  out-of-level  testing  la 
recotmoended 

—preferable  to  use  same  test  for  pre  and  posttestlng 
—when  using  the  same  test  in  two  languages^  administer 
test  first  In  l^sa  familiar  language  to  minimize  prac- 
tice effect* 

•  short  term  and  long  term  evaluation 

—some  gains  may  take  more  than  one  year  of  operation  to 
be  visible 

—performance  objectives  may  be  used  in  short  term  evalua-* 
tlon»  or  In  areas  not  readily  measured  by  achievement 
tests  * 

•  non-cognltlve  goala 

—may  be  major  project  goals 

»ron-cognltlve  measures  may  be  used  as  assessment  Instru- 
jents 

*-non*cognltlve  measures  may  be  used  to  sensitize  teachers* 
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Table  C-29  (Continued) 


2*    Monitoring  and  Improvlnft  Project  Implementation 

•  outcome  data  mudt  be  considered  In  relation  to  level  of 
implementation 

— rarely  will  all  project  claaaea  Implement  all  project 
feat urea 4 

•  conduslona  on  Implementation/outcome  data 
"project  worked  aa  planned 

»aomethlng  worked^  but  It  may  not  have  been  the  project 

— project  may  not  be  repllcable 

^^roject  may  not  have  been  given  a  fair  trial* 

•  addedslng  liq>lementatlon 

— evaluator^  project  director  develop  checkllat  of  key 
features  udlng.PIP^ 

•  evaluator  monitors  non-claaaroom  activities^ 

•  evaluator  suggeats  revlslona  to  Improve  project  Implmenta- 
tlon* 

3*    Unanticipated  Conaequencea 

•  methoda  for  finding  unanticipated  consequences  may  be 
largely  Impreaslonlatlc  but  all  data»  Interviews^  evalu* 
atlon  should  be  examined  with  thla  question  In  mlnd^ 

•  If  aome  conaequences  are  negative  they  should  be  noted » 
not  neceasarlly  corrected* 

•  consequences  of  a  personal  level  (l^e*!  staff  Interaction) 
are  alao  Important* 
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General  Conclualon 


Each  of  the  four  PlPa  conslata  of  five  or  alx  manuala  aa  well  aa 
other  informational  and  inatructional  materiala*    Thia  aummary  therefore 
encompaaaea  more  than  2*000  pagea  of  information*    The  bilingual  PlPa 
exhibit  aome  deairable  featurea  and  it  ia  hoped  that  the  diacuaaion  of 
theae  featurea  will  be  helpful  in  future  development  efforta* 

The  PlPa  provide  ataffing  conf igurationa  and  extenaive  role  deacrip- 
tiona*  two  major  areaa  of  program  deaign*    Thia  alone  ia  helpful  in  orga- 
nizing a  new  project*  and  if  a  qualified  ataff  is  selected*  may  play  a 
major  role  ia  aucceaaful  implementation*    The  role  of  project  director 
ia  aupplemented  by  a  calendar  and  a  aummary  of  taaka*    In  the  field  teat* 
thia  was  useful  to  both  experienced  and  inexperienced  directora  aa  a 
checkliat*  even  if  it  vaa  not  followed  exactly*    The  diacuaaion  of  com* 
munication  with  school  and  community*  if  it  were  compiled  acroaa  PlPa* 
would  also  be  useful  to  some  new  project  directors*    The  general  guidelines 
on  bilingual  education  and  on  the  components  of  a  bilingual  project  could 
also  serve  in  program  planning  if  their  limitations  were  clearly  under* 
stood* 

However*  a  summary  and  comparison  of  the  contents  of  the  four  PIPs 
leads  to  the  conclusion  that  there  are  major  flaws  with  the  present  design 
of  the  bilingual  PIPs* 

First*  the  existence  of  four  different  PIPs  leads  automatically  to 
a  comparison*    The  four  projects  are  generally  similar  in  staffing*  ap* 
proach*  organization*  and  instructional  content*  and  therefore  do  not 
offer  four  real  choices*    Some  differences  exist  that  could  be  signifi- 
cant* such  as  language  proficiency  of  the  target  population*  However* 
these  differences  are  superficial  and  are  not  incorporated  systematically 
into  the  goals*  approaches*  and  organizations  of  the  total  projects*  Many 
minor  differences*  such  as  number  at  classrooms*  the  role  of  the  parents* 
function  of  teacher  aide*  do  not  reflect  a  major  difference  in  goals  or 
approach*    In  relation  to  the  program  as  a  whole  they  seem  arbitrary* 
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although  they  probably  reflect  differences  among  the  originating  sites* 
and  the  documentation  of  the  programs.    In  many  instances  (e.g.*  role  of 
parents),  a  compilation  of  the  information  contained  in  the  four  PIPb 
would  be  more  useful  and  more  complete  than  what  is  contained  in  any  sin- 
gle PIP. 

Second,  the  purpose  of  the  PIPs  was  to  help  LEAs  Implement  bilingual 
programs  with  a  minimum  of  technical  assistance  by  replicating  exemplary 
projects.    But  the  PIPs  describe  general  approaches  to  multi-faceted, 
whole-day  programs  rather  than  specific  procedures  and  materials,  thereby 
making  replication,  in  the  usual  sense  of  the  word*  impossible<^    Even  by 
following  PIP  directives  faithfully,  it  would  be  unlikely  for  students  in 
an  adopter  site  to  receive  the  same  instructional  treatment  as  students 
in  the  originating  site.    If  replication  of  instructional  treatment  is  a 
goal,  much  more  specific  information  is  needed  about  bilingual*»education 
classroom  procedures,  techniques,  use  of  materials,  and  classroom  organi- 
zation. 

Third,  because  the  PIP  does  not  provide  an  instructional  system  for 
use  by  classroom  teachers,  the  question  arises  as  to  who  the  intended 
audience  is.    As  they  exist*  the  bilingual  PIPs  consist  primarily  of  man- 
agement guidelines  intended  for  project  directors.    Because  of  the  nature 
of  thit  projects,  the  packages  are  primarily  intended  for  highly  qualified, 
experienced  staff  who  are  already  knowledgeable  about  bilingual  education. 
However,  an  LEA  possessed  of  such  a  staff  is  less  likely  to  need  a  PIP 
than  a  district  with  a  less  experienced  and  less  knowledgeable  staff. 
Many  areas  of  the  PIPs  could  benefit  from  a  clearer  definition  of  the 
audience  and  a  more  limited  and  more  focused  goal  for  their  use. 

Fourth,  the  current  PIPs  address  areas  in  which  a  package  is  not 
Hkely  to  be  useful.    For  example,  materials  and  their  prices  quickly 
become  obsolete.    Hiring  practices  and  organizational  structures  at  LEAs 
are  not  easily  changed.    Student  selection,  classroom  composition,  and 
evaluation  requirements  are  subject  to  other  laws  and  regulations.  Credi- 
bility of  the  whole  package  may  be  lost  when  directives  become  dated  or 
conflict  with  other  requirements. 
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Finally»  the  PIPb  are  intended  to  promote  whole**project  adoption* 
rather  than  the  selection  among  various  components*    In  a  relatively  simple 
pull-out- type  program*  perhaps  this  concept  makes  e'tnse*  but  in  an  area 
as  complex  as  bilingual  education*  which  encompasses  a  whole-day  program 
for  several  grade  levels*  this  concept  is  impractical*    It  is  extremely 
doubtful  that  an  LEA  which  chose  Venceremos  because  of  the  culture  and 
heritage  component  would  also  wish  to  have  its  Parent  Advisory  Committee 
meet  exactly  the  aaine  nuiQber  of  times  and  perform  exactly  the  same  tasks 
as  the  Venceremos  project*  for  example*    This  is  especially  true  because 
the  function  described  in  the  PIP  reflects  what  occurred  at  the  originating 
site  and  thepo  practices  are  not  necessarily  optimal  in  another  districts 

Future  packaging  efforts  should  consider  these  issues  before  design- 
ing further  bilingual  education  materials* 
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APPENDIX  D 

PRE-  AND  POSTTEST  SCORES  FROM  PIEU)  TEST  SITES 


Pre-  and  Posttest  Scores  from  Field-Test  Sites 
Second*Year  Data 

The  conclusion  of  Substudy  II »  the  evaluation  of  project  liDpacts»  was 
that  the  In^reclslon  of  the  measurements  and  the  many  confounding  varlates 
precluded  einy  determination  of  project  Impacts  on  student  ^^hlevement  (Sec^ 
Lions  10  and  11).    However*  In  the  process  of  arrlvli  lat  decision* 

RMC  completed  an  extensive  survey  (with  some  reanalyses^       the  data  from 
the  fleld*-test  sltes»  and  reviewers  of  preliminary  drafts  of  this  report 
requested  that  achievement  test  Information  be  Included  for  the  use  of  the 
Interested  reader.    This  appendix  comprises  that  Information. 

Several  things  should  be  kept  In  mind  by  the  reader: 

•  Raw^score  gains  (or  losses)  mean  very  little.    In  all  possible 
cases*  RMC  converted  the  scores  provided  by  the  fleld*test  sites 
to  raw  scores  and  to  NCEs.    Haw  scores  are  provided  for  the 
reader  who  may  wish  to  look  up  other  acales  in  the  test  pub- 
lishers' norm  tables.    NCEs  provide  a  comparison  to  the  gains 
made  by  other  students  in  the  country  at  comparable  achievement 
levels.  However; 

•  NGE  "ftains*'  (or  losses)  do  not  Indicate  program  succeas  (or  fail- 
ure) *    It  is  poasible  thai  even  a  subatantlal  gain  represents 
poorer  performance  than  the  students  would  have  achieved  in  that 
district  without  the  program.    Similarly*  even  a  substantial  loss 
may  represent  a  great  Improvement  in  other  districts.  Further* 
there  is  a  great  deal  of  measurement  error  in  these  values »  and 
the  v&lues  may  be  systematically  distorted  by  extraneous  factors. 

«     The  '*site  codes"  in  the  tablee  do  not  correspond  to  the  order 
of  the  slt^H  in  Appendix  A.    In  order  to  preserve  the  ano;,ymlty 
of  the  sites^  these  codes  were  assigned  randomly. 
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A  A 

*  CAUTIOK  * 
A  A 

*  We  caution  the  reader  that  any  attempt  to  use  these  stores  to  support  * 

*  arguments  either  for  or  against  the  effectiveness  of        bilingual  educa-  * 

*  tlon  In  general*  or  (b)  the  bilingual  programs  In  the  19  field-test  sites  * 

*  would  be  professionally  Irresponsible*  * 

A  A 
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA:fc>tAAAAAAAAAAAAAA 


Contents 


1  *    General  notes 

2*    Information  from  each  site  on: 

•  Assef^'^n^'^nt  of  language  proficiency 

•  Assignment  to  treatment 

3*    Test  name  key 
4*  Footnotes 
5*    Data  tables 
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Genersl  Notes  APPlVlng  to  Perf ormance"Level  Data  Tables 


a*    Information  on  assignment  to  treatment  snd  language  proficiency 
groups  is  provided  to  accompany  these  tables* 

bt    These  data  were  collected  during  the  1978*79  school  year  except 
whence  otherwise  indicated* 

Ct    Means  are  converted  to  NCEs  wherever  possible  to  provide  a  nornr 
ative  method  of  cross^site  comparison*    The  NCE  metric  has  a 
mean  of  50  and  s  standard  deviation  of  21*06* 

e*    Raw  score  gains  are  not  computed  where  different  test  levels 
were  used  pre  and  post* 

f*    p«ns*    T  test  is  not  significant  at  the  *05  level* 
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Information  Sheet  to  Accompany 
Second-Year  Performance-Level  Data  Tables 


Site     Afiaesflment  of  Language  Proficiency 


Assignment  to  Treatment 


Language  dominance  classifications  were 
assigned  by  the  staff  ut  the  project* 
Four  criteria  were  used:    (1)  home  visits 
and  surveys,  (2)  LAS  scores,  (3)  per- 
foiBiance  on  achlev^nent  tests,  (4)  class- 
room observation*    Students  were  divided 
Into  three  groups  for  analysis:  LESA* 
stronger  In  English,  LESA-stronger  In 
Spanish,  and  Non*LESA*    Itegardlng  LAS 
scores:    LESA-stronger  In  English  Is 
defined  as  <3  on  English  +  Spanish  LAS 
with  English  "stronger*"  LESA^Spanish 
stronger, is  defined  ss  English  LAS  score 
<3,  Spanish  may  be  at  any  level* 


Noa*LESA  students  were 
divided  into  two  groups 
for  inctruction:  bl- 
linguals  and  monolinguals* 
All  LESA  students  were 
served  * 


Baaed  on  home  language  survey,  84%  of  par* 
ents  speak  to  their  children  exclusively 
in  Spanish*    No  language  testing  was  done 
in  the  second  year*    65%  of  families  have 
been  in  this  country  five  years  or  less* 


Students  enrolled  in  the 
state  program  were  trans- 
ferred to  the  Title  VII 
program  at  certain  grade 
levels*    Some  students  did 
not  get  into  Title  VII  be- 
cause of  administrative 
restrictions* 


"All  students  ia  grades  K-I2  participated 
in  a  home  language  survey,  screening/ 
diagnosis  procedures,  and  testing  to  de- 
termine their  primary  language* ** *The 
LAS  WES  used  in  the  fall  prior  to  November 
and  data  organized  for  systematic  identi- 
fication of  Limited  English  Proficiency 
students  at  all  grade  levels*"  [Site's 
Final  Report] 


In  genersl,  LESA  students 
were  assigned  to  Title  VII 
cXassrooQis  * 
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site     Assessment  of  LanRuage  Proficiency 


Assignment  to  Treatment 


The  PAL  (OLDM)  was  administered  to  assess 
oral  language  dominance* 


The  site  Identified  schools 
with  a  high  percentage  of 
minority  children  and/or 
schools  willing  to  partic- 
ipate*   Within  schools » 
teachers  were  selected  ac- 
cording to  bilingual  skills 
and  experience*    In  dome 
cases  LESA  students  within 
a  district  were  all  bussed 
to  one  school* 


All  students  were  considered  LESA  on  entry 
to  the  program*    For  most  students  (K»  l» 
and  2}  entry  was  at  the  kindergarten  level* 
"Since  they  have  not  exited  from  the  pro- 
gram they  are  still  being  treated  as  LESA 
students:    receiving  Instruction  In  ESL» 
and  bilingual  Instruction  In  reading  and 
math*"    (letter  from  evaluatorl  LESA 
classification  was  validated  during  the 
school  year  with  LAS  testing  and  Informa- 
tion from  a  home  language  survey* 


"Assignment  to  Title  VII 
was  based  on  educational 
need  with  teacher  recom- 
mendations given  primary 
weight* * **Wlth  very  few 
exceptions  partlclpatltig 
students  In  first  and  second 
grade  were  'veterans'  of  the 
previous  year  of  the  project* 
Parental  approval  Is  a  neces- 
sary prerequisite*"  (Site's 
Final  Report]    State  law 
requires  students  who  enter 
the  State  bilingual  program 
to  remain  until  3rd  grade* 
Also  assigned  to  the  proj- 
ect were  some  Anglo  volun- 
teers and  some  non-LESA  low 
achievers* 


Home  language  survey  Indicates  that 
83%  of  parents  have  English  as  a  native 
language*    28%  use  both  English  and  French 
at  home* 


Those  teachers  who  felt 
comfortable  Introducing  a 
bilingual  component  Into 
their  classrooms  did  so* 
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site     Aaaeasment  of  Language  Proficiency 


Aaalgnment  to  Treatment 


Other  claaarooms  became 
the  control  claaarooma* 
Parental  pennlaalon  waa 
required  for  atudent  par- 
ticipation*   The  majority 
of  the  atudenta  In  the  claaa 
mtiat  be  of  Franco  deacent» 
preferably  a  75/25  ratio* 


8       "Studenta  are  divided  Into  Francoa  and  Although  atudenta  were 

Angloa  for  analytic  purpoaea*    The  claaal-    Identified  according  to 
flcatlon  waa  originally  made  by  peraona        number  of  yeara  In  the 
In  the  school  knowledgeable  of  a  atudent'a    program  this  Information 
ethnic  background*    X«ater  In  the  year  an**     was  not  uaed  for  analyala* 
other  check  waa  made  and  a  compoalte 
score  waa  defined  to  determine  degree  of 
limited  English  Proficiency*"  [letter 
from  evaluatorJ    No  Information  la  avail- 
able on  the  nature  of  the  compoalte*  Ita 
uae  resulted  In  ''some"  atudenta  being  re- 
clsaalfled*    The  report  glvea  no  Indication 
of  analyals  grouping  being  made  on  the 
baala  of  L£P  atatua***only  on  ethnic  atatua* 


'^plla  were  aaalgned  a  language  claaalfl- 
cation  of  L£S,  NES,  FES  on  the  basla  of 
their  scorea  on  the  BSM*"    [from  data 
aheeta] 


"The  baalc  device  uaed 
for  the  Identification 
and  placement  of  puplla 
In  the  program  (and  In 
the  categorlea  of  NES» 
LES,  and  FES)  waa  the 
Bilingual  Syntax  Meaaure 
given  In  Spanlah  and  Eng^ 
llah  aa  appropriate*" 
[Slte'a  Final  Report]  Other 
criteria  uaed  for  Identl*- 
flcatlon  and  placement 
Include:    the  State  Home 
Language  Survey*  atandard- 
Ized  teat  data  In  reading 
and  math»  teacher  ratings 
of  llatenlng  6kllla»  and 
teacher  rating  of  writing 
akllla* 
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site     Assessment  of  LanguaRe  Proficiency 


Assignment  to  Treatment 


10       The  report  Implies  that  selection  of 
treatment  students  and  Identification 
of  LEP  students  were  one  and  the  same 
process* 


"Factors  used  to  select  LEF 
children  to  participate  In 
the  Title  VII  prpogram: 
(1)  home  language  survey 
provided  by  State  department 
of  education*  (2)  teacher 
rating  of  English  language 
proficiency,  (3)  the  SRA 
achievement  test;    >6  sta- 
nine  Is  non  LEP*"  [Slte^^s 
Pinal  Report]    "Within  each 
school,  classes  were  ran* 
domly  selected  to  be  In  the 
tratment  and  control  groups*" 
[Site's  Pinal  Report]  RMC 
on-site  observation  leads  us 
to  question  the  veracity  of 
this  statement*    Also,  It  Is 
difficult  to  reconcile  these 
two  pieces  of  Information 
from  the  report*    Data  In 
the  report  are  presented  by 
Treatment  and  Control  group 
with  the  Implicit  suggeatlon 
that  all  Treatment  students 
are  LEP,  as  defined  by  the 
state* 


11       The  project  director  designed  a  thorough 
set  of  criteria  to  establish  language 
dominance*    Several  factors  were  Involved; 
Scores  on  the  PAL  (OLDM),  Information  on 
literacy,  level  of  attainment  In  classroom 
reading  curriculum,  and  CTBS  achievement 
test  scores*    The  determination  of  language 
dominance  was  made  at  the  end  of  the  year* 
This  Information,  along  with  a  substantial 
amount  of  other  blographlc/demogrsphlc  In* 
formation  could  not  be  used  for  data  analy- 
sis because  of  small  Ms* 


All  classes  K*2  were  con- 
sidered candidates  for  the 
Title  VII  program  at  the 
site* 


12       To  Identify  LESA  students  the  site  used 
"primarily"  the  state  adopted  home  lan- 
guage survey  form*    "If  the  parents  said 
that  French  Is  spoken  In  the  home,  then 
we  considered  him  a  candidate  depending 


"Already  existing  classes 
whose  teachers  are  bilingual 
were  selected  for  partici- 
pation In  the  program*  They 
are  composed  of  both  French 
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site 


Assessment  of  Language  Proficiency 


Assignment  to  Treatment 


12  (continued) 

on  his  SKA  scores  ^'^    [letter  from  evslu^ 
stor]    If  no  home  language  survey  wss 
svallable  on  s  particular  student »  "tesch^ 
er  observation^^  wss  substituted^    "If  s 
student  scored  76%  or  higher  on  the  resd^ 
Ing  part  of  the  SRA»  he  Is  not  considered 
L£SA  even  If  ha  has  a  strong  French  bsck* 
ground/'    [letter  from  evaluator] 


dominant  snd  English  doml^ 
nant  children^    Because  of 
lack  of  time  between  actual 
funding  and  Implementation » 
teachera  were  unable  to 
screen  students  for  doml* 
nancy-^    Once  clssses  were 
estsbllshedt  psrtlclpsnts 
were  relstlvely  bslsnced 
sccordlng  to  Isngusge  doml* 
nancy."    [Site's  Final  Re* 
port] 


13       Students  were  clssslf led  as  LBSA  on  the 
bssls  of  teacher  judgment.    Pretest  dsta 
from  several  messures  In  both  Spanish  and 
English  were  provided  to  teachers  ss 
sddltlonsl  Information  for  clssslf Icstlon^ 


14       Students  were  classified  In  Isngusge 
dominance  groups  sccordlng  to  English 
IAS  test  scores. 

FES  *•  85-100»  Near  fluent  -  76-84» 
LES  *•  66-78,  NES  *•  0-65. 
[Site's  Flnsl  Report! 


For  first  grade  s  locsl 
control  group  of  17  stu- 
dents wss  compiled  from 
Hexlcan-Amerlcsn  children 
with  no  previous  blllngusl 
educstlon  experience^  lo- 
csted  throughout  the  dis- 
trict.   These  students 
were  tested  in  the  fsll  of 
second  grade  prior  to  re- 
ceiving the  Title  VII  pro- 
gram.   [Site's  Flnsl  Report] 


15       The  LAB  test  wss  used  to  determine 

Isngusge  proficiency  snd  ssslgn  students 
to  categories.    It  is  implied  thst  the 
site  used  the  scoring  system  developed 
by  the  publisher^  however  the  evslustor 
felt  this  system  overldentlf les  LEP 
students  {Site's  Flnsl  Report] 


^'Pupils  sre  selected  to 
psrtlclpate  in  the  Title 
VII  progrsm  in  the  aame  way 
pupils  sre  selected  for 
other  blllngusl  progrsma 
in  [Site  15].  Policy 
for  selection  procedure 
is  in  conformance  with 
stste  isw.    Psrentsl  per- 
mission is  slso  required.^' 
[Site's  Final  Report! 
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site     Assessment  of  Language  Proficiency 


Assignment  to  Treatment 


16       A  student  is  classified  LEP  by:  LAS 

English  scorers*  Spanish  LAS  score  ^1, 
achievement  test  score  In  reading  ^30%, 
classroom  reading  level  Is  one  year  or 
more  below  grade  level. 


Title  VII  entry  criteria; 
"Those  most  In  need  of 
bilingual  education,**  which 
Includes  (a)  those  with 
higher  language  fluency  In 
Spanish  than  English,  (b) 
Spanlah  surname  students 
tflth  low  language  fluency 
In  English  and  Spanish  (LAS 
level  of  I  or  2  In  both), 
(c)  Spanish  surname  students 
with  equivalent  fluency  In 
both  languages  * 


17  No  quantitative  assessment  of  English 
dominance  was  reported  |or  thla  mono- 
lingual, Spanlsh**speaklng  population* 


Control  classrooms  were  ran* 
domly  selected  by  achools* 
No  school  had  both  treatment 
and  control  classrooms. 
Program  and  control  class- 
rooms were  conaldered 
similar  on  the  following 
fou^*  soclo-demographlc  char* 
acterlstlcs:    (a)  popula- 
tion growth,  (b)  population 
density,  (c)  family  Incoine, 
(d)  percentage  of  students 
migrating  to  U.S*  Both 
treatment  and  control  class* 
rooms  were  selected  because 
of  the  high  proportion  of 
students  enrolled  who  were 
likely  to  migrate  to  the  U.S* 


18 


19       Data  are  analyzed  by  language  proficiency 
group  although  the  report  doea  not  Indl* 
cate  how  atudents  were  assigned  to  cate- 
gories*   It  la  likely  that  such  assign- 
inent  was  made  using  scores  from  the  Bi- 
lingual Syntax  Measure,  which  the  site 
administered. 


No  Information  on  aaslgn- 
ment  to  treatment. 
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Test  Name  KeV 


Nationally  Standardized  Tests 

CAT;      California  Achievement  Test 

CTBS:    Comprehensive  Test  of  Basic  Skills*    CTBS  BspaHoI  was  pub** 

Ilshed  In  1973*    It  Is  a  direct  translation  of  CTBS/S  published 
In  1974*    CTBS  total  readlug  raw  scores  are  not  comparable  across 
languages*    There  Is  one  more  subtest  In  English  than  Spanish* 
NCEs  can  be  compared* 

InterAmerlcan:    Test  of  Reading /Frueba  de  Lectura  (PL) 

Test  of  General  Ability /Frueba  de  Habllldad  General  (FHG) 
(contains  less  than  25Z  math  Items) 

HAT:     Metropolitan  Achievement  Test 

SRA:      SRA  Achievement  Series 

Locally  Developed  Tests 

ARS:     Affective  Reporting  System*    Fubllshed  by  Teaching  Research  Pub- 
lications»  Monmouth)  Oregon*    This  neaaure  requires  a  child  to 
circle  a  happy^  sad»  or  neutral  face  In  response  to  locally 
written  Items*    Therefore*  ARS  scores  are  not  comparable  across 
sites* 

French  Ach*  Test:    French  Achievement  Test*    Locally  developed  criterion 
referenced  measure  used  at  several  sites*    Composition  of  aubtests 
and  number  of  Items  varies  across  sites* 

French  Lang*  Acqu*  Test:    French  Language  Acquisition  Test*    Consists  of 
51  listening  and  oral  production  Items* 

LAB:     Language  Assessment  Battery*    Level  I  contains  40  Items* 

LAS;     Language  Assessment  Scale*    The  LAS  Level  I  consists  of  98  Items 
and  a  story-telllng  exercise* 

Mathematics  Skills  Test  (Test  of  Basic  Math  Skills}*    This  Spanish  lan- 
guage test  consists  of  25  Items^  and  was  developed  by  the  user 
site  with  the  assistance  of  Educational  Testing  Service* 

Reading  Skills  Test  (Test  of  Spanish  Skills}*    This  Spanish  language 

test  consists  of  40  Items  and  was  developed  by  the  user  site  with 
the  assistance  of  Educational  Testing  Service* 

FALi  Primary  Acquisition  of  Language  Test  (Also  called  the  Oral  Lan-* 
guage  Dominance  Measure  (OLDM)*  Consists  of  28  oral  production 
responses*  each  of  which  may  consist  of  several  words* 

PSCI:  Primary  Self '^Concept  Inventory*  Contains  20  Items  completed  by 
the  student  * 
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Footnotea 

1.  Ns  used  to  calculate  pre-  and  posttest  Dteans  were  not  restricted 
to  matched  cases.    Sufficient  infonaation  for  accurate  [patching 
not  available  from  site. 

2.  Poattest  means  were  correctly  adjusted  using  analysis  of  covari* 
ance  techniques.    Significance  levels  are  indicated. 

3.  Site  used  inappropriate  atatistical  procedures.    BMC  performed  a 
norm-referenced  analysis. 

4.  12-month  testing  interval. 

5.  tfeans  obtained  from  site  report  checked  against  raw  data  obtained 
from  site. 

6.  A  random  sample  of  students  was  posttested  to  minimize  the  test*^ 
ing  burden.    No  documentation  of  sample  selection  procedures  is 
available . 

7.  No  pretest  data  available. 

8.  A  statistically  appropriate  t*test  was  performed  between  groups. 
Significance  levels  are  reported. 

9.  a.    Means  are  not  available^  although  data  were  collected  at 

the  site. 

b.    Statistical  analysis  was  completed  at  site  and  results  re- 
ported although  data  are  not  available. 

10.  Category  scores^  not  raw  acores^  are  reported  by  the  site  for  oral 
language  testing. 

11.  Raw  scores  not  available;  numbers  reported  on  raw  score  tables  are 
expanded  standard  acores  (scale  scores)* 

12.  Mastery  level  or  growth  expectation  not  established. 

13.  Spanish  and  English  Total  Math  data  combined  at  site.    Most  test- 
ing is  in  English.    English  norms  are  used  for  NCE  conversions. 

14.  Math  computation  subtest  only. 

15.  The  report  itself  givea  slightly  different  Ns  when  reporting  raw 
scores  on  one  page  and  percentiles  on  another. 

16.  Site  used  inappropriate  statistical  procedures.    Data  available 
were  not  sufficient  for  RHC  to  perform  a  reanalysis. 
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17 4    The  aggregate  raw  score  standard  deviation  is  not  available.  A 
range  of  standard  deviations  over  five  schools  is  provided* 

18*    Students  were  tested  using  an  on**site  translation  of  the  English 
language  directions  and  test  items  of  this  test^ 

19.    Posttest  administerea  In  the  fall^    Conversion  to  NCEs  is  based 
on  expanded  standard  scores  used  for  out*of^level  testing* 

20*  No  data  were  collected* 

21*  Conversion  to  KCEs  not  possible. 

22.  Invalid  data^ 

23^  Reading  score  is  vocabulary  subtest  only. 
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Ist  Grade »  English  Reading 


Program  or 

Test)  Level) 

Raw  Scores 

HCEs 

Site 

Language 

Fornit 

Pretest 

Post test 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Mean 

S.D. 

Gain 

Mean        Mean  Gain 

LESAt  En- 

3 

1 

glish  In- 
struction 

48 

CTBS,  B(S), 
1974 

26.3 

8.8 

59.7 

13.4 

33.4 

38            51  13 

Hon-LESA 
English 
Inst rue- 

CTBS>  B(S), 

i 

tlon 

73 

1974 

38.3 

69.6 

12.6 

31 .3 

61  57-4 

76-77 

1 

English 
Dom.  LESA 

CTBS  B(S)» 
1974 

48 

78-79 

J&nglisn 

CTBS  B ( S  J  t 

1 

Dom.  LESA 

'  61 

1974 

54.8 

47 

76-77 

CTBS  B(S)t 

1 

Non-LESA 

68 

1974 

64.1 

53 

77-78 

CTBS  B(S), 

1 

Hon-LESA 

75 

1974 

66.2 

54 

9a 

2 

Title  VII 

Remedial 

3 

Title  VII 
Ist  Jtrade 

9 

CTBS  B(S), 
1974 

25.4 

6.1 

25.0 

10.5 

-  .4 

37            13  -24 

3 

Regular 
Title  VII 
1st  firade 

16 

CTBS  B(S), 
1974 

32.1 

5.6 

62.1 

II. 7 

30 

dJL  0 

InterAmerl- 

can  Test  of 

9a 

4 

Title  VII 

ReadlnR^  1966 

All 

Pre* 175 

CTBS,  B(S), 

1,3*5 

5 

Title  VII 

Po8t-169 

1974 

20.6 

8.3 

34.3 

13.8 

13.7 

24            26  2 

All 

CAT»  I» 

A, 7 

6 

Title  VII 

46 

1970 

85.2 

12.0 

59 

1st  Grade^  English  Reading  (Continued) 


Program  or 

Test,  Level, 

Raw  Scores 

>iCE8 

Site 

Language 

Form, 

Pretest 

Posttest 

Pretest  Posttest 

Footnotes 

Code 

Group 

Edition 

Mean  S.D, 

Mean 

S.D. 

Gain 

Mean        Mean  Gain 

Non- 

Title  VII 

SRA,  B  (1), 

7.8.11 

7 

Controls 

177 

1978 

143 

4? 

40 

7,11 

7 

All 
Title  VII 

176 

SRA,  B  (1) , 
1978 

138 

51 

p»ns 

38 

Pre"Metro> 
Pr liner  (H)  » 

1971 

Post-Metro  > 

1.6 

5.7 

5.17 

8 

Title  VII 
Francos 

54 

PrimaryKF)* 

•       AU144-  ^  J   *  ^       ^  p 

1971 

to 

28.5  5,5 

38.3 

to 
10,7 

38            46  8 

Pre  MAT> 

Primer (H) > 
1971 

Post-M&T, 

2,1 

3.1 

5.17 

8 

Title  VII 
AnKlos 

38 

Prima rylfp) » 
1971 

to 

30,4  8,1 

41.3 

to 
9.3 

53 

Title  VII 

CTBS,B(S) , 

5 

9 

NES 

18 

1974 

29,0 

12,9 

19 

Title  VII 

CTBS,B(S), 

5 

i 

LES 

25 

1974 

22.0  6,2 

33,0 

10,4 

U 

30            25  -5 

Title  VII 

CTBS,B(S), 

5 

9 

FES 

9 

1974 

31,0  12,6 

58,0 

19.4 

:j 

49            49  0 

5.11 

10 

Title  VII 

173 

SRA,B(1) 
1978 

87,9  35,2 

.  179,9 

66.0 

9? 

38            49  11 

5.8.11 

10 

Non- 
Title  VII 

125 

SRA,B(1) 
1978 

80.8  33,8 

174.9 

56.4 

P"ns 
94,1 

36            45  9 

Pre»CTBS 

A(S),1974 

All 

Post»CTBS , 

9a (Pre) 

11 

Title  VII 

95 

B(Si, 1974 

54,2 

i9.1 

47 

1st  Grade,  English  Reading  (Continued) 


Program  or 

Test,  Level, 

Raw  Scores 

NCBs 

Site 

Language 

Form, 

Pretest 

Posttest 

Pret  es  t 

Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean  S.D. 

Mean 

S.D. 

Gain 

Mean 

Mean 

Gain 

All 

SRA,B(1), 

4*11 

1  1 

12 

Title  VXX 

100 

1978 

70.4  28.6 

115.7 

55.2 

45.3 

41 

32 

9 

9a 

13 

Title  VXX 

Non- 

13 

Title  VXX 

8 

14 

Title  VXX 
NES/LES 

34 

CTBS,B(S), 
1974 

31.0 

64.2 

33.2 

43 

51 

8 

Local 

p<.01 

Untreated 

19 

14 

Compari- 
son Group 

17 

CTBS,B(S>, 
1974 

48.2 

16.0 

20 

Title  VXX 

CTBS,B(S), 

14 

FES 

39 

1974 

27.8 

74.4 

46.6 

42 

62 

20 

20 

15 

pre»CAT,10 
(C),  1977 

K2,4 

16 

Title  VXX 

les/nes 

pre=46 
Post=55 

post«CAT,ll 
(CL  1977 

86.5  17.2 

30.5 

10.7 

36 

40 

4 

4_.7 

16 

State 
Bilingual 
LES/FES 

pre=38 
Post=49 

pre«CAT,10 
(C),  1977 

post°CAT,ll 
(C).  1977 

79.0  20.0 

33.7 

7.5 

31 

45 

14 

All 

Title  VXX 

CAT,  2 

4.7 

16 

77-78 

70 

(C),  1970 

25.7 

9.5 

32 

Non- 
Title  VH 


FES  In 
77-78 

Title  VH                         CAT, 2 
2.4  16      Claasroom         78  fc).  1970  38.9        12.5  53 


1st  Grade »  English  Reading  (Continued) 


Program  or 

Test,  Level, 

Raw  Scores 

NCEs 

Site 

Language 

Form, 

Pretest 

Post test 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean  S.D. 

Mean  S.D. 

Gain 

Mean        Mean  Gain 

20 

17 

9a 

18 

Title  VII 

Title  VII 

CTBS,B(S), 

19 

FES 

23 

1974 

27.8  6.0 

34.5  18.6 

26.7 

43           47  4 

iBC  Grade,  Spanish /French  Reading 


Program  or 

Test^  Level, 

Raw  Scores 

NCEs 

Sice 

Language 

FonQ, 

Pretest 

Post  test 

Pretest 

Post  test 

roo  cnoces 

wQe 

Group 

Si 

Eaition 

nean 

Q  n 

nean 

Gain 

Mean 

Mean  Gain 

Title  Vll 

UliSb ,  D 

1 

1 

T  PSA 

? 

fV'z-n   \      1  077 

10  7 

1  0  •  / 

^fl  A 
JO.  *\ 

10  7 

7a 

z 

fiBiiieaxax 

lESp.J*  1977 

19.4 

18.1 

7.3 

—1  ^ 

*•!  .  J 

A  fl 

if  *z9 

iicie  Vll 

1  o 

lo 

(Esp.)*  1977 

26.6 

8.5 

54.9 

7.2 

28.3 

65 

59  "0 

9a 

A 
*l 

All 

All 

pre" 169 

CTBS,  B 

Title  Vll 

Postal  83 

(EBP.)  1977 

15.2 

0.4 

33.9 

15.2 

18.7 

35 

/  11 

40  11 

All 

All 

InterAmerican 

21 

0 

Title  Vll 

HO 

FL,  1962 

18.3 

15.3 

50.3 

15.4 

20 

7 



20 

8 

Title  vll 

CTBS,  B 

5 

9 

NES 

11 

(EsD.)*  1977 

19.0 

15.2 

31.0 

17.7 

12 

47 

42  -5 

Title  VII 

CTBS,  B 
(Esp-)»  1977 

5 

9 

LES 

40 

15.0 

4.1 

27.0 

12.1 

12 

34 

34  0 

All 

French  Ach. 

12»21 

10 

Title  VII 

? 

Test 

2.2 

1.7 

4.0 

2.4 

1.8 

9a 

U 

All 

All 

French  Ach. 

21*23 

Tide  VII 

? 

Test 

5.3 

3.2 

8.5 

4.1 

3.2 

9a 

13 

Tide  VII 

Non- 

9a 

Tic  le  VII 

Title  VII 

CTBS,B 

nes/les 

32 

(ESP.)*  1977 

21.3 

38.8 

17.5 

27 

32  5 

20 

15 

Ist  6rade»  Spanish /French  Reading  (Continued) 


Program  or 

TG3t»  Level » 

Raw  Scores 

NCEs 

Site 

Language 

Fon&  f 

Pretest 

Posttest 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.Q. 

Ifean 

S.Q. 

Gain 

Mean        Mean  Gain 

1 

16 

Title  VII 
LES/NES 

pre-62 
post'=65 

CIBStB 
(ESD.)  1977 

15.3 

8.3 

28.7 

12.0 

13. 

34           40  6 

16*21 

17 

All 
Title  VII 

130 

Spanish 
Reading 
Test 

10.6 

6.6 

24.4 

7.1 

13.8 

16*21 

17 

Non* 
Title  VII 
Controls 

89 

Spanish 
Heading 
Test 

13.4 

6.9 

2f».2 

8.5 

14.8 

20 

18 

20 

19 

O 


4! 


41 


t," 


1st  Grade,  Hath  In  English 


Program  or 

Test,  Level, 

Raw  Scores 

HCEs 

Site 

Language 

Form, 

Pretest 

Post test 

Pretest 

Posttest 

Footnotes 

Code 

Group 

H 

Edition 

Mean  S.D. 

Mean 

S.D. 

Gain 

Mean 

Mean  Gain 

LESA,  En- 

1 

glish  In- 
struction 

48 

CTBS,  B(S), 
1974 

18.3  6.3 

32.3 

8.7 

14 

41 

51  10 

1 

Hon-LESA 
English 
Instruc" 
tlon 

73 

CTBS,  B(s), 
1974 

26.0  9.1 

40.7 

9.6 

p«ns 
14.7 

62 

62  0 

77-78 

1 

English 
Dom.  LESA 

54 

CTBS  B(s)  , 
1974 

29.5 

45 

Curfent 

1 

English 
Dom.  LESA 

61 

CTBS  B(S) , 
1974 

34.1 

53 

76-77 

CTBS  B(s), 

1 

Non-LESA 

68 

1974 

3:  .0 

54 

77-78 

CTBS  B(S), 

1 

Non-LESA 

75 

1974 

39.9 

61 

2 

Remedial 
Title  VII 

CTBS  B(S) , 

3 

1st  erade 

9 

1974 

17.8  3.3 

20.6 

4.2 

2.8 

32 

14  -18 

Regular 
Title  VII 

CTBS  B(s), 

3 

1st  grade 

16 

1974 

28.2  9.7 

44.6 

12.4 

16.4 

80 

78       -  2 

InterAmerl- 

can:  Test  of 

General 

21 

4 

All 
Title  VII 

21 

Ability, 
1962 

55.3  12.0 

59.6 

9.3 

4.3 

All 

Pre"173 

CTBS,  B(S), 

1.3,5 

5 

Title  VII 

Postal 69 

1974 

14.4  7.7 

27.8 

11.1 

13.4 

29 

43  14 

1st  Grade,  Math  in  English  (Continued) 


program  or 

ies c ,  Level, 

Raw  Scores 

Site 

Language 

PoroL, 

Pretest 

Posttest 

Pretest 

Posttest 

Foo  t  no  t  es 

UOQc 

uroup 

fiaxcxon 

Mean  b*D* 

Mean 

O  aX^  • 

Gain 

Mean 

Mean  Gain 

A1  1 
■nXX 

PAT  1 
LAI ,    X  , 

A 

V 

T^^l^^  VTT 

HO 

1  Q7n 

X7  /  U 

XH  •  w 

OH 

XJ-CXc  VXX 

w  AyCX  f  O  \  X  /  f 

7*8*11 

7 

Controls 

177 

1978 

1  c;! 

XJX 

44 

7  11 

7 

A1  1 
T^^lA  VTT 

1  7fi 

X  /  D 

<;i} A  M 

OluV  )  o  \  X  ^  f 

1  Q7A 

X7  /  O 

1  c;! 
x^x 

^A 

men 

n 

44 

Pre^MA.!, 

Primer  (Vi^ 

1  Q71 
X7  /  X 

Prt  ft  tHMAT 

^  •  o 

S  17 
J.  i/ 

0 

o 

XxCXe  VXX 

JrxXQiaXjr  X      /  * 

1  071 
X7/  X 

CO 

ZO*0  XX*J 

CO 

XZ  *  H 

^A 

AA            1  A 
hD             X  D 

irre^'fULi , 

Jrrunervn/ , 

1971 

Jr09  C^'fULX  f 

Z  *  0 

A  ^ 

Txtle  VII 

Prltnaryl(P) , 

to 

to 

0 

AnKlos 

Jo 

43.7 

9.9 

Title  VII 

CXBS,B(S) 1 

5 

9 

HES 

22 

1974 

ij*  J 

33 

Title  VII 

c 

T  DC 

iy/4 

13*0  5*5 

in  / 
10*4 

1  1 
11 

ZD 

A  1             1  ^ 
4X  ID 

T-II-Ia  VTT 

X  X 1^  xe  VXX 

V>X  OO  yjy\0  /  y 

c 

1717  C 

D 

107/ 
X  3  /I 

lb  *U             D  *  J 

28.0 

13*9 

IZ 

35 

A  A  0 

A1  1 
■nXX 

ORAf  O \ X /  f 

5.11 

10 

Title  VII 

173 

1978 

106*3  16*2 

160.0 

36.9 

53.7 

36 

57  21 

5.8,11 

10 

non- 
Title  VII 

125 

SRA,B(1)> 
1978 

106.3  22*8 

154.3 

33.2 

p=n3 
48.0 

34 

53  19 

Pre«CTBS 

A(S),1974 

All 

Post=CTBS, 

11 

Title  VII 

95 

B(S)^1974 

35.8 

56 

1st  Grade,  H^rh  in  English  (Continued) 


Proerdm  or 

Test.  Level. 

Rav  Scores 

NCEe 

Site 

LdngUcige 

FoiJiy 

Pretest 

Posttest 

Pretest 

Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Kean  S.D. 

Mean 

S.D. 

Gain 

Mean 

Mean  Gain 

All 

SRA  Bdi 

4,12 

12 

Title  VII 

100 

1978 

95.9  21.3 

131.0 

25.7 

35.1 

37 

36       -  1 

9a 

13 

Title  VII 

Non- 

9a 

13 

Title  VII 

CTBS^B, 

13.14 

14 

Title  VII 
NES/LES 

32 

(S  &  EsD.). 
1974  &  1977 

21.0 

37.0 

12.1 

16 

49 

58  9 

Local 

Untreated 

15.19 

14 

Compari- 
son Group 

17 

CrBS,B,(S), 
1974 

19.2 

8.8 

24 

Title  VII 

CTBS,B,(S), 

15 

14 

FES 

40 

1974 

18.8 

47.2 

28.4 

43 

69  26 

10 

15 

pre"CAT, 10 
(C),  1977 

1.2,4 

16 

Title  VII 

les/nes 

pre«46 

postnCAT, 11 
(C)j  1977 

15.5  30.0 

36.6 

9.5 

41 

45  4 

pce"CAT, 10, 

State 

(C),  1977 

1.2.4 

16 

Bilingual 
LES/FES 

pre«39 
por>t-48 

post-CATpll 
(C),  1977 

13.7  4.0 

36.7 

8.8 

34 

45  11 

20 

17 

9a 

18 

Title  VII 

CTBS,B,(S) 

19 

FES 

23 

1974 

16.3 

41.7 

35 

63  28 

1st  6rade»  Hath  in  Spanish/French 


Program  or 

Test)  Level) 

Raw  Scores 

NCEs 

Site 

Language 

Fomit 

Pretest 

Post test 

Pretest  Posttest 

Footnotes 

Coaz 

Group 

Edition 

Mean 

S.D. 

Mean 

S.D. 

Gain 

Mean        Mean  Gain 

CTBS,  B 

1 

LESA 

? 

(EsP.),  1977 

16.8 

29.7 

12.9 

38            48  10 

20 

2 

Remedial 

CTBS,  B 

3 

Title  VII 

9 

CEsp.),  1977 

16.9 

3.8 

18.9 

3.7 

2 

37            22  -15 

Regular 

CTBS,  B 

3 

Title  VII 

18 

(Esp.),  1977 

27.7 

8.6 

43.2 

9.1 

15.5 

69            67  -2 

All 

pre»21 

InterAmerican: 

3.21 

4 

Title  VII 

post"? 

PHG.  1962 

48.2 

5.6 

60.9 

10.9 

12.7 

All 

pre- 16? 

CTBS,  B 

1.3,5 

5 

Title  VII 

j»ost-183 

(Esp.),  1977 

14.4 

6.4 

27.0 

11.3 

12.6 

31            45  14 

All 

Inter American: 

21 

6 

Title  VII 

46 

PHG.  1962 

37.6 

7.7 

65.8 

5.6 

28.2 

20 

7 

20 

8 

• 

CTBS,  B 

9 

NES 

14 

fEsp.>,  1977 

9.0 

7.8 

21.0 

14.0 

12 

10            26  16 

CTBS,  B 

9 

-^ES 

34 

(EsP.).  1977 

16.0 

3.8 

27.0 

11.3 

11 

35            44  9 

Ail 

French  Ach* 

10 

Title  VII 

? 

Tbsl 

11.3 

6.2 

17.5 

7.8 

6.2 

20 

11 

All 

Preach  Ach. 

21 

12 

Title  VII 

? 

Test 

8.4 

4.7 

17.6 

9.2 

.8 

9a 

13 

Title  VII 

13,  See 

EnR.  Math 

14 

All 

HAT,  Primer 

18 

15 

Title  VII 

100 

1978 

33.9 

8.6 

53 

Non- 

Title  VII 

HAT,  Primer 

18 

15 

Controls 

20 

1978 

32.4 

7.1 

45 

1st  Grade,  Math  In  Spanish /French  (Continued) 


Program  or 

Test,  Level, 

Raw  Scores 

NCEs 

Site 

Language 

Form, 

Pretest 

Posttest 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Mean  S.D. 

Gain 

Mean        Mean  Gain 

Tide  VII 

pre»62 

CTBS,  B 

5 

16 

NES/LES 

Post"65 

(EsD.),  1977 

16.1 

8.9 

32.5  12.8 

16.4 

35            52  17 

All 

>tethematics 

21 

17 

Title  VII 

132 

Skills  Test 

9.8 

5.9 

19.0  4.0 

9.2 

Non- 

Title  VII 

Hathematics 

21 

17 

Controls 

122 

Skills  Test 

12.6 

5.5 

17.5  5.1 

i.9 

2Q  18 

20  19 


o 

00 


4nv 


1st  Grade,  English  Oral  Lattguage 


Program  or 

Test,  Level, 

Raw  Scores 

NCEs 

Site 

Laneuase 

Form , 

Pretest 

Pont:  fen  t 

Pr fitefit  Pos  ttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Mean  S.D. 

Gain 

Mean         Mean  Gain 

LESA 

2.21 

1 

Spanish 
Instr. 

22 

English 
LAS. 1.1977 

55.3 

18.4 

65.7  20.6 

10.4 

LESA 

2*21 

1 

English 
Instr. 

17 

English 
LAS*I.1977 

71.4 

15.8 

73.2  20.2 

1.8 

2^21 

1 

Non-LESA 

32 

English 
LAS, 1^1977 

93.3 

6.5 

86.8  11.3 

-6.5 

20 

2 

20 

3 

3*21 

4 

Title  VII 

pre* 12 
post*? 

Enelifth 
LASjI_tl977 

54  8 

16  0 



84 .9  15.2 

30.1 

All 

pre*158 

10,21 

5 

Title  VII 

Postal 6 8 

Enalish  PAL 

1  s 

1  n 

2.6  ,  1.2 

1.1 

21 

6 

All 
Title  VII 

English 

T  A^. T. 1 Q77 

71  fl 

ft^  1  8.6 

11.3 

20 

7 

20 

A  V 

9a 

9 

20 

10 



9a 

11 

20 

12 

ya 

13 

21 

14 

KES/LES 

35 

English 
LAS*I*1977 

64.2 

75.1 

10.9 

15 

All 
Title  VII 

75 

English 
UBa^l976 

19.8 

7.8 

Non- 

lb 

Title  VII 
Controls 

25 

English 
LAB,IU976 

20.4 

5.6 

2.6.21 

16 

Title  VII 
LES/KES 

pre»68 
postal  14 

English 
LAS. I. 1977 

52.6 

14.8 

85.9  20.0 

23.3 

4C0 


1st  Grade,  English  Oral  Language  (Continued) 


Program  or 

Test»  Levels 

Raw  Scores 

NCEs 

Site 

Language 

Forai^ 

Pretest 

Post test 

Pretest  Podttest 

Footnotes 

Code 

Group 

H 

Edition 

Mean  S.D. 

Mean  S.D. 

Gain 

Mean        Mean  Gain 

23.0 

State 

116 

Bilingual 

pre«6l 

English 

(pre/ 

2*6,21 

16 

LES/FES 

post"  1 6 

LAS3I.I977 

65.9  15.3 

88.9  12.9 

DOSt) 

20 

17 

20 

18 

9a 

19 

o 


'    4  c  i 


Idt  Grade»  Spanish/French  Oral  Language 


Program  or 

Test|  Level  1 

Raw  Scores 

NCE8 

Site 

Language 

Forsi| 

Pretest 

Post test 

rretest  rost\.^^st 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Mean 

S.D. 

oain 

Mean        Me^n  Oain 

LESA 

1 

Spanl sh 
Instr . 

LAS«1«1977 

70.8 

18.3 

63.0 

20.4 

-7*8 

LESA 

1 

Englidh 
Instr. 

17 

LAS» 1»1977 

35.3 

24.9 

40.9 

22.4 

5*6 

Non— L£SA 

1 

English 
Instr. 

32 

LAS» 1 »i977 

23.8 

26.9 

33.0 

22.9 

9*2 

20 

2 

2U 

3 

Al  1 
All 

A 

iicxe  Vll 

1  /j 

X4 

T  A C    1     1 077 
liAb  »  X  »  X  7  /  / 

2.0 

1.3 

3.1 

1.4 

1.1 

All 

All 

pre  "=13  B 

PAL 

in  91 

«f-tt*lA  VTT 
lIcXc  Vll 

pus  C'lOp 

3.4 

1.2 

4.3 

1.0 

Q 

Al  1 
All 

*>1 

rp  J  t,i  -    Tf  TT 

Title  vll 

TAP     1  lO^T 

LASt 1 » 1977 

61.0 

14.8 

1* 

J^^encn  Lang . 

llcXc  Vll 

Ac^u .  Tes  1 1 

S  91 

Q 

o 

ivrancus 

T  A^fAl  TT 

iievex  11 

16.8 

27.8 

1  1 
1  X 

French  Lang. 

Title  VII 

Acqu.  Test| 

(5  91 
^  t^X 

J3 

T           1  TT 

Level  11 

17.5 

27.8 

in  ^ 

XU  .J 

9a 

9 

Title  VII 

20 

10 

9a 

11 

Title  VII 

20 

12 

9a 

13 

Title  VII 

21 

14 

Title  VII 
FES 

37 

Spanish 
LASa,1977 

13.5 

4f:i 


1st  Grade^  Spanish /French  Oral  Language  (Continued) 


jrrogram  or 

lea  Hi  Levex t 

Xtow  oCuxes 

Site 

Foinn  1 

P 1^^^  &  e  ^   Pa  q  ^      q  ^ 

Footnotes 

Code 

Group 

H 

Edition 

^Mean       S.D*       Mean  S*D. 

Gain       Mean        Mean  Gain 

21 

14 

T-f^ld  VTT 
HES /LES 

LAS  1  1977 

7A*6 

20 

All 

9a 

16 

Title  VII 

State 

9a 

16 

Bilingual 
LES/FES 

20 

17 

20 

18 

9a 

19 

l3t  Grade,  Affective  Testing 


TpAt*      1  p^/p1 

Raw  S cor as 

Site 

un  U  K  U  C^Ju  C- 

Pretest 

Post test 

Pl*pt Pfit  Poft pet' 

t*  f  n  t*  0c 

f  W  L-  1*U  L-  Co 

Hean 

S.D. 

Mean 

0  all  • 

Ail  ^  n 

Tltlp  VTT 

1 

All   ^  A 

■JO 

P<!rT      1  Q7A 

li.u 

2.5 

13.5 

line  vij 

1 

1 

DuK •  insLr* 

90 

uer'T     1 Q7A 

14.1 

1.9  14.3 

2.  i 

line  vii 

19  91 

1 

1 

/O**/  / 

1  /J 

11  »1 

2.9 

11.6 

2.5 

ii-txe  vxx 



19  91 

1 

1 

1  /J 

12.0 

Z  •  7 

2.2 

1  A 
1  •  D 

12ft2l 

1 

76-77 

10 

PSCIft  1974 

li.2 

2  3 

13  2 

X  ^  •  ^ 

0.0 

Hon-IESA 

1  9  91 
1  ^  ft  ^  1 

1 

X 

77—78 

1  n 

UQPT      1 Q7A 

1  A  ^ 
I't  •  -J 

1.8 

14.5 

1  .X 
X  •  J 

20 

2 

20 

3 

Ail 

9a 

4 

Title  VII 

PSCI*  1974 

(78-79) 

pre*»169 

Iftl2ft21 

5 

Title  VII 

post«181 

PSCL  1974 

12.3 

13.3 

Same 
Group 

Grade  K 

12,21 

5 

77-78 

112 

PSCI.  1974 

11.4 

All 

12,21 

6 

Title  VII 

46 

rSCI^  1974 

13.3 

3.0 

14.5 

2.1 

20  7 


20  8 


J 


1st  Grade I  Affective  Testing  (Continued) 


Pi'ogram  or 

Tftst,  Level, 

Raw  Scores 

NCEs 

Site 

Language 

Form, 

Pretest 

Post test 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Meai)  S.D. 

Gain       Mean        Mean  Gain 

9a 

9 

Title  VII 

20 

10 

20 

11 

20 

12 

20 

13 

20 

14 

9a 

15 

Title  VII 

pre  - 

Title  VII 

pre«62 
iDid-66 

2Te 

X  = 

mid 

X  = 

£pst 
X  - 

post 

1.12,21 

16 

LES/NES 

po8t"59 

ARS 

A1.7 

42.8 

51.2 

9.5 

Title  VII 

Classroom 

mid  - 

English 
Mono- 

inid=63 

mid 
X  - 

£.OSt 

X  =• 

post 

1,12,21 

16 

linKual5. 

post»68 

ARS 

46.1 

49.4 

3.3 

20  17 


20  18 

20   19 


4* 


2nd  Grade^  English  Reading 


Program  or 

Test»  Levels 

Raw  Scores 

NCEs 

Site 

Language 

Form> 

Pr*:test 

Posttest 

Pretest 

Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean  S.D. 

Mean 

S.D. 

Gain 

Mean 

Mean 

Gain 

20 

1 

*> 

Title  VII 

_ 

All 

CT3S,C(S)» 

3 

Title  VII 

17 

1974 

21.0  4.5 

34.2 

13.8 

13. 2 

22 

35 

12 

InterAinerlcan 

Test  of 

1  *>  1 

4 

Title  Vll 

11 

Readln^f  1966 

/  ^     1  Inn 

47.1  19.0 

61.0 

17.1 

13.9 

All 

All 

pre* 144 

CTBS  »C(S} » 

Title  VII 

Post=140 

1974 

19.6  o.o 

26.9 

1A.6 

7.3 

lo  .9 

26 .3 

7 

All 

D 

Title  Vll 

54 

CAT* 1*1970 

79.1  10.7 

100.0 

12. A 

20.9 

57 

51 

*  6 

Non*- 

Title  VII 

SItA,B(l)» 

7 

Controls 

178 

1978 

214 

55 

44 

SItA,B(l)» 

p*"ns 

7ai 

7 

Title  VII 

161 

1978 

213 

5A 

44 

3.7 

8.1 

5,17 

8 

Title  VII 
Francos 

63 

MAT » Primary 
II.  1971 

to 

47,0  9.3 

5-S.l 

Co 
11.5 

9.1 

55 

59 

4 

4.1 

6.2 

5.17 

8 

ntle  VII 
Anglos 

31 

MAT, Primary 
II.  1971 

to 

45.3  11.9 

54.3 

Co 
12.6 

9 

49 

53 

4 

Title  VII 

CTBS»C(S) » 

5 

9 

NES 

18 

1974 

26 

8. A 

33 

Title  VII 

CTBS»C(S)» 

5 

9 

LES 

34 

1974 

22  9.8 

29 

15.6 

7 

24 

28 

4 

Title  VII 

CTBS,C(S)» 

5 

9 

FES 

20 

1974 

26  15.1 

49 

15.6 

23 

32 

44 

12 

22 

10 

Title  VII 

Non- 

22 

10 

Title  VII 

2nd  Grade^  English  Reading  (Continued) 


Program  or 

Test^  Level* 

Raw  Scores 

NCEs 

Site 

Lancuace 

C  L  ^  t  C  9  t 

Posttest 

Pretest  Posttest 

Knn  t  fin  **  ^ft 

Code 

Group 

N 

Edition 

Mo  a  n 
£  iC  all 

S  D 

vaxii 

Mean 

ore^CTBS  *A 
(S)»  1974 

All 

nost=CTBS 

11 

Title  VII 

26 

(S)*  1974 

25 . 5 

4Z  .  z 

An  7        1  n 

All 

SRA  BQ) 

4  11 

12 

Title  VII 

80 

1978 

123  1        46  4 

188.3 

55.0 

34 

34  0 

9a 

13 

Non" 

9a 

13 

Title  VII 

Title  VII 

CTBS,C(S), 

14 

NES/LES 

27 

31  0 

51.7 

9n  7 

40 

45  5 

Title  VII 

CTBS,C(S), 

14 

FES 

36 

1974 

42.8 

63  2 

20.4 

51 

53  2 

20 

15 

pre^CAT^ 11 
(C),  1977 

1,2*4 

16 

Title  VII 
LES/NES 

ore =5': 
post=55 

post=CAT>12 
(C),  1977 

29.0  8.5 

39.0 

13.4 

38 

39  1 

State 

pre«CAT,ll 
(C),  1977 

16 

Bilingual 

les/fes 

pre=18 
oost=22 

po8t»CAT^12 
(C).  1977 

26.3  5.9 

38  3 

14  2 

33 

38  5 

Title  VII 

post=CAT,ll 

4  7 

16 

77*78 

54 

(C).  1977 

29.0 

8.5 

38 

State 

16 

Bilingual 
77-78 

18 

CAT,  11 
_LC_1.  1977 

26.3 

5.9 

33 

20 

17 

9a 

18 

Title  VII 

Title  VII 

C1'BS,C(S), 

19 

FES 

21 

1974 

29.3  14.3 

58.9 

10.6 

29.6 

J8 

50  12 

Title  VII 

CTBS,C(S), 

19 

LES 

3 

1974 

19.7  1.9 

44.3 

8.7 

24.6 

20 

41  21 

2nd  Grade »  Spanish/ French  Reading 


Program  or 

Test)  Level) 

Raw  Scores 

NCEs 

Site 

Laitguage 

Pretest 

Post test 

Pretest  Posttest 

Footnotes 

Code 

Group 

Edition 

Mean 

S.D. 

Mean 

S.D. 

Gain 

Hean        Mean  Gain 

20 

1 

20 

2 

CTBS,  C 

All 

(Esp . } 

5 

3 

Title  VII 

17 

1977 

29.6 

7.6 

37.2 

10.9 

7.6 

39  37-2 

Inter- 

All 

Anterican: 

3 

Title  VII 

28 

PL»  1966 

i.O 

46.4 

15.6 

16.3 

CTBS,  C 

All 

pre*>141 

(Esp. ) 

1.3.5 

5 

Title  VII 

Post-142 

1977 

19  6 

9  I 

28  9 

9.3 

20            31  11 

Inter— 

All 

i^er  ic  An ; 

6 

Title  VII 

54 

PL.  1966 

44.6 

12.7 

36.8 

11.7 

-  7.8 

20 

7 

20 

8 

CTBS*  C 

5 

9 

Title  VII 

14 

1977 

II  3 

19 

31            42  11 

CTBS,  C 

5 

9 

TltlA  VII 
LES 

37 

1977 

21,0 

10.2 

32.0 

14.9 

11 

24            34  10 

All 

French 

12 

10 

Title  VII 

? 

Ach.  Test 

8.4 

4.3 

14.7 

6.2 

7.3 

9a 

11 

Title  VII 

All 

French 

12 

Title  VII 

? 

Ach.  Test 

3.7 

1.9 

6.3 

3.2 

2.6 

9a 

13 

Title  VII 

CTBS,  C 

14 

Title  VII 
NES/tES 

25 

(Esp.) 
1977 

24.4 

43.1 

18.7 

43            60  17 

2nd  Grade»  Spanish/French  Reading  (Continued) 


rrograui  or 

les  c 1  Levex i 

Raw  Scores 

NUiSs 

Site 

Language 

Form» 

Pretest 

Post test 

Pretest 

Post test 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S  .D. 

Hean 

bmUm 

Gain 

Mean  Gain 

1  q 
1 J 

16 

Title  VII 
LES/NES 

53 

(Esp-) 
1977 

31.9 

11.7 

40.8 

12.9 

0 . 9 

42 

1  7 

T-fhlo  UTT 

122— 

Spanish 
Reading 
les  t 

33*3 

0.3 

44.5 

9.3 

1  (\  ^ 
lU  .Z 

Non- 

Spanish 



If) 

Title  vii 
Controls 

1  1  S 

Reading 
les  c 

27.7 

iU  .  D 

JO.  J 

12.0 

1 U  .  D 

rf  J  ^  1  a  VTT 

^EiSp  •  J 

1  Q 

1  077 

27.0 

2.8 

61.8 

5.1 

ft 

JO  ZZ 

CTBS,  C 

Title  VII 

(Esp.) 

19 

LES 

2 

1977 

23.5 

2.5 

54.5 

3.5 

31 

35 

52  17 

CTBS,  C 

Title  VII 

(Esp.) 

19 

NES 

2 

1977 

29.5 

5.5 

47.0 

19.0 

17.5 

39 

48  9 

47. 


47  V 


2nd  Grade,  Math  In  English 


Program  or 

Test,  Level, 

Raw  Scores 

NCEs 

Site 

Language 

Form, 

Pretest 

Posttest 

Pretest 

Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean  S.D. 

Mean 

S*D* 

Gain 

Mean 

Mean 

Gain 

20 

1 

9a 

2 

All 

CTBS,C(S), 

5*21 

3 

Title  VII 

17 

1974 

20*5  6.3 

31*0 

4*6 

10*5 

36 

42 

6 

In  t  e  r Ame  r  ic  an 

Test  of 

All 

General 

?.21 

4 

litle  VII 

21 

Ability*  1962 

50*1  12*0 

62*0 

8*3 

11*9 

1,3,5 

5 

All 
Title  VII 

pre«I44 
post-140 

CTBS,C(S), 
1974 

16*6  7*5 

30*6 

12*0 

14 

26 

41 

15 

All 

6 

Title  VII 

54 

CAT, 1.1970 

59*5 

14*8 

34 

Hon* 

Title  VII 

SRA,B(1), 

7.8ai 

7 

Controls 

178 

1978 

204 

40 

52  ' 

All 

SRA.Bd), 

p™ns 

7,11 

7 

Title  VII 

161 

1978 

202 

46 

54 

4*8 

5*6 

5.17 

8 

Title  VII 
Francos 

61 

HAT,  Primary 
II*  I97I 

to 

48*8  12*2 

57*0 

to 
10*0 

8.2 

62 

50 

-12 

5*1 

5*6 

5,17 

8 

Title  VII 
Anj^los 

31 

MAT, Primary 
II*  I97I 

to 

48*1  10*2 

55*9 

to 
17*3 

7.8 

58 

48 

10 

Title  VII 

CTBS,C(S), 

5 

9 

ms 

18 

1974 

32*8 

11*7 

44 

Title  VII 

CTBS,C(S), 

5 

9 

L£S 

37 

1974 

16*0  5*8 

27*0 

10*1 

11 

25 

36 

11 

Title  VII 

CTBS,C(S), 

5 

9 

FES 

22 

1974 

17*0  6*9 

32*0 

8*5 

15 

27 

44 

17 

22 

10 

Title  VII 

Kon- 

22 

10 

Tltle  VII 

2nd  Grade,  Math  in  English  (Continued) 


PrograiQ  or 

Test,  Level, 

Raw  Scores 

NCEs 

Site 

X  vxut , 

Pretest 

Post  test 

P  i*o  1*  e^  1* 

Footnotes 

Code 

Group 

N 

Edition 

Me  AH 

S.D. 

Me  AH 

S*D* 

6a  J  n 

Mean 

Mean 

Gain 

All 

CTRS  CfS) 

wXlJw,w^w/  , 

5 

11 

Title  VII 

52 

1974 

£v  *  £ 

6.7 

3fi*fl 

9*0 

7  *  V 

16.6 

35*1 

51*6 

16 

Enffllsh 
Tlnirff  n  An  1* 

5 

11 

Anglos 
(Subgroup) 

10 

CTBS.CfS), 
1974 

ft  .  1 
O  *  X 

J7  *  b 

10*1 

15.9 

41*3 

55*3 

14 

12 

All 
Title  VII 

80 

SRA  B/I>. 

X  7  /  O 

1  "lA  A 
i^o  *o 

7fk  7 

lAO  Q 

lOv  *  7 

3^  1 
*  1 

42.1 

42 

43 

1 

9a 

13 

Title  VII 

9a 

13 

Title  VTT 

CTBS,C 

8^13 

14 

NESTLES 

25 

1974  &  1977 

24.5 

40.5 

44 

57 

13 

DO  ,  U 

15  19 

14 

Title  VII 

36 

(S&Esp*), 
lQ7i  &  1Q77 

44  *  Z 

53 

64 

11 

20 

15 

n*>AHPAT     1  1 

pre"LAi 1 11 

1Q77 

1,2,4 

16 

Title  VII 

XJLvXC  VXX 

LES/NES 

^  X  C 

poflt"5  5 

nn^  t*rAT  1 ? 

^USt  V**wAX  ,  Xb 

fr>.  1977 

33.2 

8.1 

40*3 

10.4 

38 

40 

2 

State 

nremCAT  *  1 1 

(C),  1977 

1.2,4 

16 

Bilingual 

les/fes 

Post»33 

post"CAT,12 
(C),  1977 

29.9 

8.1 

38*3 

10.8 

34 

38 

4 

20 

17 

9a 

18 

Title  VII 

Title  VII 

CTBS.C(S}. 

19 

FES 

23 

1974 

24.0 

6.7 

48*5 

3.8 

24.5 

43 

47 

4 

Title  VII  CTBS,C(S), 
19  LES  3  1974  15.7         1.2       42.0         4.3       26.3         25  60  35 


2Dd  Grade^  Spanish/ Breach  Math 


Progr^JD  or 

Testt  Levelt 

Raw  Scores 

NCEs 

Site 

Language 

?oro&^ 

Pretest 

Posttest 

Pretefit  Podttedt 

Footnotes 

Code 

Group 

nean 

O  *lF* 

nean 

O  *lF  * 

Gain 

tfean         tfean  f^ln 

20 

1 

20 

9 

20 

3 

• 

Inter" 

Aioerican* 

A 

11 ^le  vix 

nur*      1  Q  A  9 

/  *0 

3/  *  z 

0  n 
0  *U 

11  f, 
1 1  *  o 

U1J}0|  U 

1.3.5 

5 

A1 1 

Title  VII 

pre*" J 
post=142 

(Esp . } 
1977 

1  A  0 
10  *7 

*  J 

117 

10  *  / 

11.4 

30           35  5 

inter™ 

6 

Title  VII 

54 

juEier  lean  * 
PHG.  1962 

01  *  J 

0*7 

7 

0 

UlJJOf  U 
1  077 

g 

Title  VTT 
NFS 

1 A 
i*f 

0  0 
7  *Z 

00  *u 

0 

7*0 

16.0 

"i?             AB  11 

9 

T-f    1  &  VTT 
XlXXc  ¥JLJ- 

LES 

45 

V&sp* / 
1977 

17*0 

6*8 

27.0 

10*5 

10*0 

30            32  2 

All 

Frenclv 

1»2»12 

10 

Title  VII 

? 

Ach*  Test 

17*4 

5.9 

22.6 

7*6 

5*2 

9a 

11 

All 

French 

12 

Title  VII 

? 

Ach*  Test 

10*2 

6*4 

24.7 

11*3 

14*5 

9a 

13 

13 »  See 

Euft*  Math 

14 

S3 


>1  w 


2nd  Grade »  Spani&h/French  Math  (Continued) 


Program  or 

Te&t^  Le^rel^ 

Raw  Scores 

NC£f 

Site 

Language 

Fontt> 

Pretest 

Posttest 

Pretest 

Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Mean 

S.D. 

Mean 

S.D. 

Gain 

tfean 

tfean  Gain 

All 

20 

15 

Title  VII 

Non- 

MAT^>  Pri- 

24 

15 

Title  VII 
Controls 

14 

mary  If 
1978 

53.6 

9.9 

39 

CTBS^C 

5 

16 

Title  VII 
NES/LBS 

53 

(Ksp.) 
1977 

30.9 

10.7 

41.6 

10. 1 

10.7 

52 

58  6 

All 

Hat hematics 

17 

Title  VII 

112 

Skills  Test 

18.9 

4.2 

23.8 

4.5 

4.9 

Non- 

Title  VII 

Hat hematics 

17 

Controls 

114 

Skills  Test 

16.3 

4.5 

21.9 

5.7 

5.6 

20 

18 

CTBS.C 

19 

Title  VII 
FES 

5 

(Esp.) 
1977 

22.6 

8.0 

49.2 

1.9 

26.6 

34 

49  15 

CTBS,  C 

19 

Title  VII 
LES 

2 

(Esp.) 
1977 

20.5 

5.5 

40.5 

5.5 

■  20.0 

32 

45  13 

CTBS,  C 

19 

Title  VII 
NBS 

2 

(Esp.) 
1977 

15.5 

6.5 

46.5 

4.5 

31.0 

28 

48  20 

4bw 


2ad  Grade»  English  Oral  Language 


Program  or 

Test»  Level » 

Raw  Scores 

-- 

NCES 

Slee 

Language 

Form, 

Pretest 

Post test 

Pretest  Posttest 

FooChoCes 

Code 

Group 

H 

Edition 

Mean 

S.D. 

Mean  S.D. 

Gain 

Mean        Mean  Gain 

20 

1 

20 

2 

20 

3 

10.21 

4 

All 
Title  VII 

14 

English  LAS, 
1.  1977 

3.4 

1.4 

4.1  1.2 

.7 

10.21 

5 

All 
Title  VII 

pre"118 
post«141 

English  PAL 
(OLDM) , 1975 

1.8 

1.1 

3.3  1.1 

1.5 

21 

6 

All 
Title  VII 

54 

English  LAS, 
U  1977 

82.8 

13.3 

88.9  9.8 

6.1 

20 

7 

20 

8 

9a 

9 

Title  VII 

20 

10 

9a 

11 

Title  VII 

20 

12 

9a 

13 

Title  VII 

21 

14 

All 
Title  VII 

30 

Ettgllsh  LAS, 
1.  1977 

72.1 

80.0 

7.9 

15 

Title  VII 
Controls 

34 

English 
LAB, 1.1976 

25.0 

5.5 

6.21 

16 

Title  VII 
LES/NES 

pre-60 
postals 

English  LAS, 
1977 

70.2 

11.3 

88.2  9.7 

18.0 

State 

P"ns 

2.6,21 

16 

Bilingual 

les/fes 

pre"24 
Post"14 

English  LAS 
1.  1977 

73.8 

2.1 

89.8  10.3 

16 

20  17 


2Q  18 

9a  19 


4SS 


2nd  Grade »  Spanish/French  Oral  Language 


Progr8m  or 

Test*  Level* 

Raw  Scores 

HCEs 

Site 

L8neu8ge 

Form* 

Pretest 

Po3ttest 

Pretest  Posttest 

Footnotes 

Code 

Group 

N 

Edition 

Me8n 

S.D. 

Mean  S.D. 

Gain 

Mean        Mean  Gain 

20 

1 

20 

2 

20 

3 

10.21 

4 

All 
Title  VII 

13 

Sp8nish  LAS 
1977 

2.4 

1.6 

2.2  1.3 

-.2 

10*21 

5 

All 
Title  VII 

pre-118 
post"141 

Sp8ni3h  PAL 
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Introduction 


This  appendix  comprises  the  detailed  tiiodel»  in  outline  formatt  of  the 
intended  bilingual-PIP  diffusion  system*    Because  the  system  was  an  exper- 
imental one»  planning  at  the  level  of  detail  included  here  was  not  expli- 
citly carried  out*    Many  of  the  statements  represent  implicit  procedures 
or  conditions  as  deduced  by  the  BMC  staff* 

Whether  the  implicit  assumptions  of  the  system  planners  (USOE)  are 
accurately  reflected  or  not  is  relatively  unimportant*    In  terms  of  the 
analyses  done  in  this  study»  innaccuracies  would»  at  worst»  introduce 
straw  men  into  the  results  and  conclusions*    That  is»  we  may  have  recom- 
mended some  steps  that  were  actually  carried  out»  or  we  may  have  recom- 
mended against  procedures  that  were  never  contemplated  by  USOE*  Aside 
from  some  possible  problems  of  these  kinds»  we  believe  that  the  model- 
served  the  analysis  function  that  we  intended* 

As  a  planning  tool»  minor  inaccuracies  in  this  model  are  irrelevant* 
since  the  first  t^tep  in  using  the  model  for  planning  a  new  system  would  be 
a  complete  revision  of  the  model*    The  purpose  of  the  model  in  this  case 
would  be  to  focus  attention  upon  the  many  system  components  and  procedures 
that  must  be  taken  into  account  and  to  illustrate  the  interactions  among 
these  cotoponents  and  processes* 

The  principles  underlying  the  organization  of  the  model  are  described 
in  Section  5  of  Volume  II*    Figures  6  and  7  from  Volume  II  are  included  here 
to  summarize  the  overall  organization  and  the  descriptive  conventions  used 
in  the  model* 
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Figure  6*    Descriptive  conventions  for  diffusion-system  models* 


42 ; 

530 


GROUPS 

BIITIAL 
(MNDI- 
TIOKS 

STAGES 

PREPARATK 

?M 

SELECTIOl 
ADOPTIO] 

START-tJ] 

OPERAlK 

M 

USOE 

Processes 

Out- 
comes 

Processes 

Out- 
comes 

Processes 

Out- 
comes 

Processes 

Out- 
comes 

Action  1 Time 

Action! Time 

Action] Tine 

Action] Time 

Diffusers 

Target 
LEAs 

I 

Figure  7.    Framework  for  the  "intended"  Pip-diffusion  system  model. 
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DIFFUSION  SYSTEM  MODEL 


USOE 

A*  Personnel 

1-    Initial  Conditions 

•  goals/attitudes 

—goals  include: 

-  replicating  of  effective  projects  In  sites  which 
need  them 

-  determining  whether  packaging  is  an  effective 
iDGthod  of  spreading  promising  practices 

*  finding  ways  of  Improving  achievement  of  bilin* 
gual  students 

*  continued  role  in  federal  dissemination 

—attitudes  include: 

*  positive  attitudes  toward  bilingual  education 

*  willingness  to  objectively  consider  relevant  data 
and  act  on  it,  within  political  constraints 

•  skills/knowledge 

—skills  include: 

*  ability  to  set  priorities  among  goals  and  to 
formulate  workable  plans  for  bilingual  project 
diffusion 

*-  ability  to  effectively  formulate  RFFs,  select  con* 
tractors  and  monitor  contracts  for  bilingual  dif^ 
fus ion 

-  ability  to  mobilize  OE  and  congressional  support 
for  goals 

*  ability  to  work  with  various  personnel  and  agen- 
cies in  carrying  out  plans 

"knowledge  base  includes: 

*  general  awareness  of  the  state  of  the  art  in  bilin- 
gual education,  packaging,  diffusion  and  evaluation 

*  general  awareness  of  LEA  needs  and  resources  in  the 
area  of  bilingual  education 

*  general  awarenesa  of  laws,  policies  and  other  con** 
straints  affecting  diffusion  of  bilingual^ projects 

•  roles/image 

—roles/responsibilities  flexible  enough  to  adapt  to 
needs  of  diffusion  plan 
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— personnel  responsible  for  diffusion  have  positions 
suitable  for  Initiating  plans 

— OE  viewed  by  potential  adopters  as  legitimate  broker/ 
sponsor  of  exemplary  bilingual  projects 

—personnel  and  agencies  within  QE  have  clearly  de-^ 
fined  and  non-conf llctlng  areas  of  responsibility 

^personnel  In  key  positions  have  vorklng  relationships 
within  OE  that  will  help  support  their  efforts 

#  availability 

-**relevant  QE  personnel  have  time  to  commit  to  bllln* 
gual  diffusion  effort 

Preparation  for  Diffusion 

Processes 

#  select 

"relevant  OE  personnel  assign/assume  responsibility 
for  packaglng/dlf fusion  effort 

#  train/ Inform 

—relevant  OE  personnel  Inform  key  groups  In  Congress 
and  within  OE  about  diffusion  plans 

—relevant  OE  personnel  train  themselves  on  specific 
packaging  and  diffusion  Issues  by  reviewing  available 
literature  and  soliciting  Inputs  from  diffusion 
agents »  LEAs»  and  technical  consultants 

-  types  of  projects  to  be  diffused  (messages) 

-  LEA  needs  and  characteristics  (markets) 
potential  of  existing  networks  (channels) 

-  types  of  packaging  (products) 

—relevant  OE  personnel  consider  complementarity  between 
message »  market »  channel*  and  product 

—relevant  OE  personnel  learn  specifics  about  lawB| 
policies  and  procedures  that  are  likely  to  Impinge 
on  diffusion  effort 

#  elicit 

— OE  motivated  by: 

*  availability  of  JDRP^approved  bilingual  projects 

-  LEA  need  for  bilingual  projects 

*  congressional  pressure  to  diffuse  exemplary  proj- 
ects»  to  develop  bilingual  education  programs*  to 
use  cognitive  achievement  gains  ss  evidence  of 
effectiveness  of  funds  provided  LEAs 
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promising  prellminsry  reaultd  from  the  field  test 
of  packaged  compeiidatory  education  projects 

— OE  constrained  by: 

-  bilingusl  education  regulations 

-  bureaucratic  procedures/guidelines 

pressure  to  utilize  existing  diffusion  network(s} 

•  sllocate 

-^relevant  OE  personnel  coordinate  diffusion  plans/ 
activities  among  relevant  psrticipants 

Outcomes 

•  goals/ attitudes 

—placement  of  bilingusl  projects  in  sites  vhere  needs 

and  resources  are  compatible 
— replicstion  by  adopters  of  key  features  of  selected 

project 

— ultimately^  the  attainment  in  adopter  sites  of  achieve* 
meat  gains  similar  to  those  in  originating  sites 

—compatibility  of  bilingual  diffusion  plans  with  other 
efforts 

•  skills/knowledge 

—relevant  OE  personnel  know  sbout  packsging  and  diffu** 

sion  (messageSi  markets^  channels  and  products)  and 

about  their  complementarity 
—relevant  OE  personnel  know  about  laws,  policies  and 

bureaucratic  procedures  that  are  likely  to  constrain 

diffusion  effort 
—relevant  OE  personnel  fcnov  that  local  sites  seem 

able  to  replicate  at  least  some  types  of  projects  when 

they  receive  funds  to  do  so* 
—relevant  OE  personnel  know  that  there  is  a  need  for 

bilingual  projects 

•  roles/image 

—relevant  OE  personnel  have  appropriate  roles 
-^E  personnel  carry  out  responsibilities  for  prepara- 
tion for  diffusion  (in  relation  to  personnel,  other 
resources  and  constrsints) 

•  availability 

—relevant  OE  personnel  hsve  sufficient  time  committed 
to  effectively  arrange  for  diffusion  of  projects 
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Se  16"  c  t  i  oaf  Adop  t  ion 
Processes 

•  select 

••relevant  0£  personnel  replace/ expand  staff  as  needed 

•  train/ inform 

— relevant  0£  personnel  and  field  test  evaluation  con- 
sultants monitor  diffusion  agents  and  adopter  sites 

•  elicit 

••relevant  OE  personnel  inform  congress  of  program  prog- 
ress end  plans 

—relevant  OE  personnel  commun  icate  within  and  between 
OE  agencies 

•  allocate 

—relevant  OE  personnel  coordinate  diffusion  activities 
within/between  agencies  (e.g.»  Office  of  Bilingual 
Education^  Office  of  Evaluation  and  Dissemination) 

Outcomes 

•  goals/ attitudes 

— key  congressional  people  have  favorable  attitudes 
toward  OE's  bilingual  education  diffusion  efforts 

—personnel  in  relevant  OE  agencies  have  favorable 
attitudes  toward  bilingual  education  diffusion 
program 

—relevsnt  OE  personnel  have  attitudes  toward  diffu- 
sion mechanism  that  reflects  recent  experience/ 
knowledge 

•  skills/knowledge 

— relevant  OE  personnel  and  field  test  evaluation 
consultants  have  some  knowledge  of  the  nature  of 
selection/sdoption  activities  and  the  degree  to 
which  they  met  OE's  goals 

•  roles/ image 

—relevant  OE  personnel  continue  to  have  appropriate 
roles 

•  availability 

—relevant  OE  personnel  continue  to  have  t?.me  to  com- 
mit to  bilingual  diffusion  effort 
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Start-Up 


Processes 

•  select 

^"-relevant  OE  personnel  replace/ expsnd  staff  as  needed 

•  train/Inform 

"relevant  OE  personnel  and  field  test  evaluation  con* 
sultants  monitor  diffusion  agents  and  adopter  sites 

•  elicit 

"relevant  OE  personnel  Inform  congress  of  program  prog*- 

ress  and  plsns 
"relevant  OE  personnel  communicate  within  and  between 

OB  agencies 

•  allocate 

— relevant  OE  personnel  coordinate  diffusion  activities 
among  relevant  participants 


Outcomes 

•  goals/attitudes 

~key  congressional  people  hove  favorable  attitudes 
toward  OE's  bilingual  education  diffusion  efforts 

"personnel  In  relevant  OE  agencies  have  favorable 
attitudes  toward  bilingual  education  diffusion 
program 

— relevant  OE  personnel  have  attitudes  toward  dlffu-* 
slon  mechanism  that  reflect  recent  experience/ 
knowledge 

•  skills/knowledge 

"relevant  OE  personnel  and  field  test  evaluation 
consultants  hove  some  knowledge  of  the  nature  of 
selection/ adoption  activities  and  the  degree  to 
which  they  met  OE's  goals 

•  roles/image 

—relevant  OE  personnel  continue  to  have  appropriate 
roles 

•  availability 

-^relevant  OE  personnel  continue  to  hove  time  to  com^ 
mlt  to  bilingual  diffusion  effort 
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Operation 

Proceasea 

•  aelect 

—relevant  OE  peraonnel  replace/expand  staff  as  needed 

•  train/inform 

-^relevant  OE  peraonnel  and  field  teat  evaluation  con- 
aultanta  monitor  diffusion  agenta  and  adopter  sltea 

•  elicit 

—relevant  OE  personnel  Inform  congress  of  program  prog- 

resa  and  plans 
-^relevant  OE  personnel  communicate  within  and  between 

OE  agencies 

•  allocate 

-^relevant  OE  personnel  coordinate  diffusion  activities 
wlthln/between  agencies 


Outcomes 

•  goala/attltudes 

~key  congresalonal  people  have  favorable  attitudes 
toward  OE's  bilingual  education  dlffualon  efforts 

-^relevant  OE  peraonnel  have  favoraiile  attitudes 
toward  bilingual  education  diffusion 

"relevant  OE  personnel  have  attltudea  toward  dlffu- 
alon mechanism  that  reflect  recent  experience/ 
knowledge 

•  ski 11b /knowledge 

^relevant  OE  personnel  and  field  test  evaluation 
conaultant  have  aome  knowledge  of  the  nature  of 
aelectlon/adoptlon  activities  and  the  degree  to 
which  they  met  OE'a  goala 

•  roles/image 

"relevant  OE  personnel  continue  to  have  appropriate 
rolea 

•  availability 

-^relevant  OE  personnel  continue  to  have  time  to 
commit  to  bilingual  dlffualon  effort 
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other  Resources 


1*    Initial  Conditions 

a*    Materials /Equipment 

•  content /appearance/availability 

—information  on  diffusion  of  projects  is  available 

(e*gM  diffusion  literature) 
—information  on  projects  to  be  diffused  is  available 

(e*g*|  evaluations^  proposals)  « 

•  roles /Image 

—information  on  diffusion  and  projects  is  seen  as 
credible  by  QE  personnel 

b*  Facilities 

—office  space  for  relevant  OE  personnel  is  available^ 
adequate,  and  situated  favorably  for  carrying  out 
duties 

Funds 

•  availability 

—funding  available  or  obtainable  is  in  amount  suffi* 
cient  to  support  diffusion  strategy  selected 

—relevant  OE  personnel  and  congress  approve  of  the 
use  of  funds  to  diffuse  bilingual  education  projects 

2*    Preparation  for  Diffusion 

a*  Materials 

Processes 

•  aelect 

-^E  personnel  select  relevant  materials  for  review 
(e*g*,  on  diffusion  and  projects) 

•  develop/modif y 

~0E  prepares  any  policy  statements,  position  papers, 
etc*,  necessary  to  communicate  within  OE  and  with 
Congress 

•  allocate 

~0E  personnel  distribute  policy  statements,  reports, 
etc*,  within  and  between  agencies 

Outcomes 

•  position  papers,  policy  statements,  reports,  etc*, 
are  available,  adequate,  and  acceptable  to  relevant 
OE  personnel 
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b*  Facilities 


Processes 

#  relevant  OE  personnel  develop^  modify^  and  allocate 
their  facilities  as  required  by  diffusion  activities 

Outcomes 

#  office  space  continues  to  be  available^  adequate^  and 
mil  located 

c*  Funds 

Processes 

#  relevant  0£  personnel  obtain  and  allocate  funds  for 
their  efforts  In  carrying  out  diffusion  plans 

Outcomes 

#  adequacy 

"-sufficient  funds  are  available  to  support  0£  per* 
sonnel  carrying  out  diffusion  plans  (l4e*»  over  a 
reasonable  (Ime  period  and  at  a  level  that  allows 
the  necessary  tasks  to  be  carried  out) 


Select lon/Adoptlon 
a*    Materials /Equipment 
Processes 

•  0£  personnel  select^  develop^  modify^  and  allocate 
(distribute)  necessary  materlalc  for  their  agencies 
(e*g*,  copies  of  diffusion  materials  for  monitoring 
purposes) 

Outcomes 

•  Needed  materials  and  equipment  (e*g*|  tape  recorders^ 
slide  projectors)  are  In  the  hands  of  relevant  OE 
personnel  In  each  agency 

b*  Facilities 

Processes 

•  relevant  OE  personnel  select »  develop,  modify^  and 
allocate  their  facilities  as  required  by  their  diffu- 
sion activities 
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Out comes 


•  adeqdate  office  space  for  0£  personnel  continues  to 
be  available 

c«  Fufjds 

Processes 

•  relevant  OE  officials  allocate  funds  ss  needed  for 
monitoring,  providing  technical  assistance  or  other 
leadership  In  diffusion  activities 

Outcomes 

•  sufficient  funds  are  available  to  support  OB  personnel 
In  diffusion  activities 

4«  Start'Dp 

•  Same  aa  Selection/Adoption 
5«  Operation 

•  Same  as  Selection/Adoption 


Flans  and  Constraints 
l«    Initial  Conditions 
a«  Plans 

•  OE  personnel  have  a  range  of  plans  for  project  dlf* 
fusion  and  other  activities 

Constraints 

•  OE  personnel  operate  within  congressional  mandates, 
budgets,  and  other  limits.  Including! 

— the  nature  of  the  projects  to  be  Identified  for 
diffusion 

— the  nature  of  existing  diffusion  network(s) 

"federal  and  state  regulations 

"^-bureaucratic  procedures/guidelines 

«state  of  the  art  of  research  and  evaluation  (e«g«. 

Identifying  factors  leading  to  success  of  projects) 
«the  national  Infrastructure  (readiness  for  change 

In  schools,  technical  expertise  regionally,  etc«) 
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2*    Preparation  for  Diffusion 
a*  Plana 

Processes 

•  relevant  OE  personnel  select^  develop »  and  Htodify 
diffusion  plans  for  all  subsequent  stages  and  compo- 
nents; state  them  in  RFP'si  policy  statements^  etc* 

Outcomes 

•  diffusion  plans  are  adequate^  available^  and  accept- 
able within  OE  and  reflect  the  wishes  of  Congress 

b*  Constraints 

Processes 

€  select/develop/modify 

—within  bureaucratic/political  constraints^  relevant 
OE  personnel  refer  to  and  formulate  policies  and 
guidelines  consonant  with  diffusion  plans 
~to  the  extent  possible^  relevant  OE  personnel  modify 
existing  policies  that  conflict  with  diffusion  plans 

3*    Selection/ Adoption 

•  Same  as  Preparation  for  Diffusion 
4*  Start-up 

•  Same  as  Preparation  for  Diffusion 
5*  Operation 

•  Same  as  Preparation  for  Diffusion 
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DIFFUSERS 


A-  Personnel 

1.    Initial  Conditions 

•  goals/attitudes 

-"provide  assistance  to  LEAs  to  improve  their  educa- 
tional prograios 
—maintain  an  assistance  role  toward  LEAs 
—positive  attitudes  toward  bilingual  education 
»not  opposed  to  a  federal  role  in  educational  dis- 
semination 

•  skills /knowledge 
—facilitator  skills 

-  human  relations 

-  contacting  key  people 

-  following  through  with  plans/actions 
—knowledge  of  how  LEA  and  school  operates 
— knoy7.edge  of  local  people  and  structures 
—knowledge  of  content  and  teaching  methodology  in 

relevant  grades 
—knowledge  of  SEA  operation 
—basic  knowledge  of  OB  operations 

•  roles /image 

—have  working  relationships  with  other  diffusers» 
lEAa  and  SEAs 

—the  kind  of  person  that  LEAs  would  see  as  credible 

•  availability 

—pool  of  potential  diffusers  available  to  carry  out 
bilingual  project  diffusion  plans 

2*    Preparation  for  Diffusion 

Processes 

•  select 

— 0£  identifies  potential  diffusers  both  within  and 
outside  of  existing  networks  and  considefsHiheir 
qualifications  and  availability  in  relation  to 
diffusion  plans  and  credibility  with  LEAs 

— OE  selects  diffusers  or  groups  of  diffusers  via 
contracts  or  other  incentives 

•  train/ inform 

— OE  continually  informs  diffusers  of  plans  and 
constraints 

—diffusers  communicate  with  one  another  and  sites 
about  successful  diftu.^ion  strategies 
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— OE  and  contractor(8)  train  diffusers 

-  diffusion  goals  and  plans 

-  project  analysis 

-  use  of  diffusion  materials 

-  expected  performance  of  diffusers  in  terms  of 
numbers  and  nature  of  adoptions  to  achieve 

*  Specific  types  of  LEAs  to  target 

*  matching  needs/resources  of  sites  to  available 
projects 

— OE  (and  technical  consultants)  use  effective  methods 
in  training  diffusers 

*  sufficient  time  to  cover  content  in  depth 

*  training  strategies  appropriate  to  goals 

— OE  communicates  role  of  bilingual  project  diffusers 
to  other  relevant  personnel  at  state»  regional*  and 
local  levels 

~diffusers  study  materials  on  local  school  districts 

"diffusers  study  diffusion  materials 

"diffusers  participate  in  training  provided  by  OE 
(atid  technical  consultants) 

~diffu6ers  contact  relevant  personnel  at  state»  re^ 
gional»  and  local  level 

*  inform  thm  of  plans/activities 

*  seek  information  on  related  plans /activities 

-  seek  advice  on  delecting /approaching  LEAs 

•  elicit 

— OE  elicits  agreement  from  diffusers  to  proceed  on 
the  basis  of  OE  objectives 

— diffusers  elicit  motivation  from  the  relevant 
personnel  at  state»  regional*  and  local  levels  by 
offering  cooperation*  respecting  their  territory 

•  allocate 

— -OK  assigns  service  areas  to  diffusers 
"diffusers  allocate  tasks  mong  their  own  staff  Co 
carry  out  diffusion  activities 

Outcomes 

•  goals/attitudes 

—goals  of  diffusers  are  not  in  opposition  to  those  of 
OE 

*  number  of  adoptions 

*  nature  of  adoptions  (site  match*  replication) 

*  types  of  LEAs  to  be  contacted 
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-"diffuaera  are  wHling  to  act  within  plana/confltraintfl 
cotmnuttZcated  by  OE 

-*di££u8er8  are  motivated  to  participate  in  the  dif* 
fusion  of  bilingual  education  projects  via  packages 

"^relevant  others  at  state,  regional  and  local  levels 
are  supportive  of  effort  to  diffuse  bilingual  educa- 
tion projects  via  packages 

•  skills /knowledge 

-*diffusera  are  knowledgeable  about 

-  diffusion  materials 

-  overall  diffusion  plans  and  constraints 

-  types  of  LEAs  to  contact 

-  their  roles  and  reaponsibilities 
effective  dif fusion/change  agent  atrategiea 

-*diffuaera  are  skilled  at 

*  analyzing  projecta 

*  matching  project  requirements  with  district 
resources 

-^relevant  personnel  at  r^ional*  state,  and  local 
levels  are  knowledgeable  about  bilingual  PIP  project 
diffuaion  effort 

•  roles/image 

-*diffusers  and  their  staffa  have  appropriate  roles 
and  tine  coimtiitiaents  to  carry  out  diffusion  plans 

-*diffusera  are  viewed  as  appropriate  and  legitimate 
technical  assistants 

•  availability 

-*diffu8ers  with  appropriate  skills,  attitudes*  k*^owl- 
edge^  roles,  and  image  are  available  to  carry  out  OE 
diffuaion  plans 


Selection/Ad option 
Processes 

•  select 

-*wlthin  political^  bureaucratic,  and  legal  constraints; 
OE  replaces  diffusers  Who  do  not  perform  within  accept- 
able limits;  or  maintaina  aqppropriate  size  network 

-*diffusera  replace/expand  their  own  staff  as  needed 

•  train/inform 

continually  informs  diffusers  of  plans,  progress 
-*diff users  share  techniques,  successes,  and  failures 

with  other  diffusers 
"diffusers  continually  inform  relevant  r^ional  state 

and  local  personnel  of  their  activities 
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•  elicit 

~0B  presents  incentives  for  diffusers  to  meet  goals 
at  this  stsge 

•  allocate 

~di££users  coordinate  activities  among  their  own  staffs 
— diffutters  involve  relevant  regional,  state,  and  local 
personnel  as  needed 

Outcomes 

•  goals/attitudes 
~diffusers  have  high  morale 

•  skills /knowledge 

"diffusers  are  knowledgeable  about  OB  plans 
"diffusers  know  about  techniques,  activities  of  other 
diffusers 

"Other  relevant  personnel  know  about  diffuser  activi- 
ties 

•  roles/ image 

"diffusers  continue  to  have  appropriate  roles 

•  availability 

"diffusers  who  perform  within  acceptable  limits  con- 
tinue to  be  available 


Start-Up 

Processes 

•  select 

— within  political,  bureaucratic,  and  legal  constraints; 
OB  replaces  diffusers  who  do  not  perform  within  accept- 
sble  limits;  or  maintains  appropriate  size  network 

"diffusers  replsce/expand  their  own  staff  as  needed 

•  train/ inform 

— OB  continually  informs  diffusers  of  plans  and  progress 
"diffusers  share  techniques,  successes,  and  failures 

with  other  diffuaers 
"diffusers  continually  inform  relevant  regional  state 

and  local  personnel  of  their  activities 

•  elicit 

—OB  presents  incentives  to  meet  goala  at  this  stafe 

•  allocate 

"diffusers  coordinate  activities  among  their  own  staffs 
— diffusers  involve  relevant  regional,  state,  and  local 
personnel  as  needed 


Outcomea 

#  . goal&/attltude& 

~dlf£u&er&  have  high  mor&le 

#  skills/knowledge 

~dlffu&er8  are  knowledgeable  about  OB  plans  ^ 
~dlffu&er&  know  about  techniques*  activities  of  other 
dlffu&er& 

~other  relevant  personnel  know  about  dlffu&er  sctlv- 


#  roles/image 

~dlffu&er&  continue  to  have  appropriate  roles 

#  availability 

~dlffu&er&  who  perform  within  acceptable  limits 
continue  to  be  available 


Other  Resources 

1*    Initial  Conditions 

a*    Materials /Equipment 

#  literature  relevant  to  diffusion/ change  agent  strate* 
gles  Is  available 

#  reports  and  other  materials  that  provide  Information 
about  local  school  districts  are  available 

Facilities 

> 

#  adequate  office  spsce  Is  available  or  obtainable 

#  funding  Is  obtainable  for  dlffusers  (or  available  for 
existing  diffusion  networks) 


Itles 


5*  Operation 


Processes 


#    Same  as  Start*Up 
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Preparation  for  Diffusion 
a*  Mjteriala/EquiPment 
Processes ; 

•  select/develop /modify 

~diffuderd  coordinate  with  one  another  with  OE  and 
with  contrators  to  selects  develop^  or  modify  any 
materials  needed  to  support  diffusion  efforts  (for 
communication  network^  reporting^  etc.) 

•  allocate 

**0E  Allocated  and  distributes  materials  (including 
PIFs)  to  diffusers 

— diffusers  distribute  materials  to  relevant  diffu- 
sion personnel  at  regional^  state»  and  local  levels 
as  needed 

— diffusers  distribute  diffusion  materials  among  their 
own  staff  members  as  needed 

Outcomes 

•  supplementary  materials  (e^g-^  charts*  pamphlets^ 
forms)  are  available  in  adequate  quantities  and  are 
acceptable  to  diffusers  and  their  staffs 

•  relevant  personnel  at  regional^  state»  and  local  levels 
have  adequate  supply  of  diffusion  materials 

•  diffusers  and  their  staffs  have  adequate  supply  of 
diffusion  materials  (including  PIFs)  to  carry  out 
OE  plans 

b*  Facilities 

Processes 

•  diffusers  acquire  appropriate  new  facilities  or  modify 
existing  facilities >  as  needed 

Outcomes 

•  adequate  office  space  is  available 
~space  is  adequate  to  house  staff 

~space  is  adequate  to  house  supply  of  diffusion  ma^ 
terials  needed 
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c*  Funds 

Processes 

OE  sllocstes  funds  to  diffusers*    The  amount  of  funds 
is  determined  in  psrt  on  the  bssis  of 
*-<-oversll  diffusion  plsn 
~locsl  cost  of  living  fsctors 
—need  to  motivste  diffusers 

•  diffusers  provide  funds  to  personnel  st  regionsl» 
stste»  locsl  levels  ss  needed  for  Sdsistsnce  in 
diffusion  sctivities 

•  diffusers  sllocste  funds  sccording  to  OS's  snd  their  own 
diffusion  plsns 

Outcomes 

•  diffusers  hsve  sufficient  funds  to  csrry  out  diffusion 
plsns 

3*  Selection/Adoption 

•  Ssme  ss  Prepsrstion  for  Diffusion 
4*  Stsrt^p 

•  Ssme  ss  Prepsrstion  for  Diffusion 
5*  Operstion 

•  Ssme  ss  Prepsrstion  for  Diffusion 
Plsns  snd  Constrsints 

1*    Initisl  Conditions 
s*  Plsns 

•  USOE,  S£Aa»  snd  LEAs  have  plsns  regsrding  needs  for 
diffusion  effort  (these  rsnge  from  well  developed 
networks  with  clesr  plsns  to  locsl  needs  sssessments 
implicitly  pointing  to  sdoption  needs) 

b*  Constrsints 

•  federsl/stste/locsl  lsws»  regulstions»  guidelines* 
policies  thst  hsve  impsct  on  diffusion  sctivities 
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Preparation  for  Diffusion 
a*  Plans 

Processes 

#  OE  personnel  arrange  for  diffusion  of  exemplary  bi- 
lingual education  projects  via  packages  (e*g*|  Issue 
RFPs»  arrange  for  monlterlng) 

#  contractors  submit  proposals  to  act  as  dlffusers  of 
bilingual  education  projects  (via  packages) 

#  dlffusers  develop  plans  for  conducting  awareness 
activities  and  subsequent  work  with  LEAs  to  select » 
start  up  and  operate  bilingual  education  projects 

«    dlffusers  plan  for  a  continuing  role  as  needed  to 
support  effective  project  diffusion 

Outcomes 

#  tentative  plans  for  carrying  out  diffusion  activities 
b*  Constraints 

Processes 

#  dlffusers  formulate  staff  policies »  procedures  that 
are  consonant  with  diffusion  plans 

#  to  the  extent  possible*  dlffusers  and  OE  personnel 
work  to  modify  any  existing  external  pollcles/gulde-^ 
lines  that  conflict  with  diffusion  plans 

Outcomes 

t    Internal  and  external  policies /guidelines  support 
diffusion  activities 

Select  Ion  Mdop  t  Ion 

a*    Plans  and  Constraints 

Processes 

#  dlffusers  reformulate  plans,  strategies,  and  policies 
as  needed* 
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Personnel 


1.    Initial  Conditions 

a*    Decision  Makers  (School  Board»  superintendent  and 
assistants) 

*  goals/attitudes 

— favorable  political  climate  toward  bilingual 
education  (based  on  earlier  good  experience  vs. 
result  of  pressure  groups) 
— priorities  In  district  Include  bilingual  education 
— goals  are  flexible  enough  to  admit  a  new  project 

*  skills /knowledge 

**blllngual  education  knowledge  (practical*  based 

on  experience) 
— expertise  In  administration 

-^knowledge  of  funding  sources  and  funding  agency 

procedures 
—political  sawy 

— practical  knowledge  of  schools  (through  visits* 

teacher  contacts*  etc.) 
— bilingual*  blcultural  (some  administrators) 
—knowledge  of  community  sentiments 

•  roles /image 

~power  locus  In  district  Identifiable 
— hierarchy  In  district  definite 

— ethnic  and  linguistic  background  matches  community 

•  availability 

— ready  for  contacts  (with  other  administrators  and 

community) 
—able  to  attend  meetings 

b.    Potential  Project  Directors 

•  goals/attitudes 

— favorable  toward*  committed  to  bilingual  education 
—professional  aspirations  appropriate  (e.g.*  desire 

for  administrative  position) 
—accepts  cultural  differences 

—priorities  suitable  for  directing  bilingual  project 

*  skills /knowledge 

— language  ability  (bilingual) 
—administrative  skills 

—training  skills  (for  bilingual  education) 
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~aware  of  cultural  differencee  and  cheir  implica-^ 

tions 
— blculcural 

—political  aawy  In  dlecrlcc 
-^knowledge  of  bilingual  education 

#  rolee/ Image 

-*poeltlon  In  dlecrlcc  (peniianence»  ecatu8»  auchorlcy) 

#  avallablllcy 

~clme  for  duties*  meetlnge»  concacte 
—suitable  candidates  for  position  are  available 

Potential  Project  Staff  (teachera,  aldee»  coordinators, 
etc») 

#  goals/attltudee 

— favor  bilingual  education 
— accept  etudente'  home  cultuve 
— reepect  etudente'  language 
—accept  minority  etudente  (doee  not  have  low 
expec tat lone) 

#  akllle /knowledge 

—have  knowledge  of  dletrlct 
— teaching  ability 

— blllngual/blllterate/blcultural  (or  experience 

with  culture  of  etudente) 
—bilingual  education  ekllle  (e.g.,  teaching  reading 

In  Spanleh) 
—group  communication  ekllle 

—bilingual  evaluation  skllle  (standardized  teetlng, 
monitoring  performance,  dlagnoels) 

#  rolee/lmage 

—role  etructure  In  dletrlct  allowe  bilingual  aldee 
to  be  Instructore  and  project  teachere  to  partlcl*- 
pate  In  decisions 

—ethnic  group  memberehlp  appropriate 

— effect Ivenees  ae  teachere  accepted 

— etaff  active  In  declelon  making 

#  availability 

— eufflclent  number  of  candldatee  available  to  fill 
rolee 

reeource  teachere 
-  Inatructloral  aides 
*  volunteera 

community  llalson/coordlnator 
—appropriate  ethnic  and  linguistic  repreeentatlon 
acroaa  etaff  categorlee 
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Evaluator 


•  goals/attitudes 
—committed  to  sound  evaluation 

•  skills/knowledge 

~know8  principles  of  sound  evaluation  design*  test^ 
ing  procedures  and  instruments)  and  bilingusl  pro^ 
gram  evaluation  issues 

~bilingual/biliterate  (to  observe  classrooms  and 
evaluate  tests) 

•  roles /Image 

"credible  position  within  or  outside  district 

•  availability 

— oB'-site  or  locally  available 

Regular  School  Personnel  (principal,  teachers,  etc*) 

•  goals/attitudes 

"favor  bilingual  education 

—accept  students'  home  culture 

"loyalty  among  staff,  toward  principal,  toward 

project  and  director 
—respect  student's  langusge 
— a^'cept  minority  students  (does  not  have  low 

expectations) 

•  skills /knowledge 

—have  knowledge  of  district 

"teaching  ability  (for  regular  teaching) 

— bilingual/biliterate/bicultural  (or  experience 

with  other  cultures) 
"knowledge  of  bilingual  education 
— bilingual  education  skills  (e*g.,  teaching  resding 

in  Spanish) 

— familiarity  with  and  sensitivity  to  students' 

culture  and  customs 
—group  communication  skills 

— bilingual  evaluation  skills  (standardized  testing, 
monitoring  performance,  diagnosis) 

•  roles/image 

—principal  and  other  personnel  have  appropriate 

balance  of  authority  and  constraint 
—ethnic  balance 

—staff  active  in  decision  making 

•  availability 

—stability  (vs*  transiency)  of  staff 
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*— composition  of  certificated  and  non-certif icated 

staff  appropriate  (ethnic  and  linguistic  background) 
—transiency 

f  *    Conimunity  and  Parents 

•  goals/attitudes 

—attitudes  toward  cultural  and  linguistic  minorities 
—attitudes  toward  involvemert  in  school  affairs 
—attitudes  toward  schools  bilingual  education  and 
the  ay stem 

"attitudes  toward  language  use>  inaintenance  of  home 
language  and  culture 

•  skills/knowledge 

—prepared  to  make  Impact  (political  sophistication* 

organizing  skilla»  familiarity  with  school  procedures) 
—education  level 

-languages  and  language  varieties  in  use 

•  roles /image 

— preasure  groups  (self -organized  vs^  school*organized)  . 

—media  presentation  of  minorities 

—organized  (PAC»  etc*) 

— ethnic »  linguistic  composition 

—tensions  among  groups 

—group  members  appointed  (by  whom) 

•  availability  (for  participation) 

—working  parents  (including  mothers  working  with  their 

small  children) 
—rural/urban  area  (distance) 


Preparation  for  Diffusion 
a*    Decision  Hakers 
Processes 

•  train 

— OE  and  dxifusers  make  DM's  aware  of  difxuaion  issues 
and  possibilities 

•  elicit 

— OE  and  diffusers  develop  Incentives  which  will 
encourage  DMs  to  favor  diffusion 

Outcomes 

•  goals/attitudea 

— DHa  regard  project  adoption  as  a  possibility 
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Potential  Project  Jtaff 


Processes 

#  train /inform 

^OE  arranges  for  training  teachers  to  be  bllngtial 
— OE  arranges  for  tralalng  bilingual  teachers  In 
bilingual  education  skills 

#  organize /as sign 

— OE  arranges  for  re-locate  bilingual  people 

Outcomes 

#  skllls/knowledge/avallablllty 

«-*blllngual  teachers  with  adequate  bilingual  educa- 
tion knowledge  are  available  at  sites  which  need 
projects 


Selection/Adoption 

a*    Decision  Makers  (Federal  Project  Officers*  Assistant 
Superintendent)  proposal  writer »  etc*) 

Processes 

#  select 

— dlffusers  Identify  relevant  DM's 

#  train/Inform 

«-*Declslon  Hskers  (DHs)  have  contact  with  dlffuuer 
(IRC,  SEA;  either  DM  or  dlffuser  can  Initiate  con- 
tact) 

«-*DHs  Inform  non-public  school  officials  that  project 
Is  available  for  LES  students 

«-*DHs  attend  conventions »  etc* 

«-*DHs  read  Federal  Register 

«-*DHs  read  printed  diffusion  pamphlets»  etc* 

«-*DHs  Inquire  (as  necessary)  about  availability  of 
personnel  and  other  resources »  laws  and  policies 
(local)  state  and  federal)  affecting  project;  deter- 
mine compliance  requirements 

«-*DHs  use  feedback  of  staff  and  comomnlty  In  planning 

#  elicit 

«-*OBE  or  state  officials  Invite  DM  to  apply  for  fundr 
«-*dlffusers  Impress  DHs  with  Importance  of  bilingual 

project)  encourage  DHs  Interest  In  adoption 
«-*Offlce  of  Civil  Rights  cites  district  for  non- 

compllance)  calls  for  Lau  remedies 
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•  allocate 

"Superintendent  assigns  responsibility  (e*g.»  for 
proposal  writing)  to  Federal  Projects  Officer* 
potential  PD»  or  other  person 

Outcomes 

•  goals/attitudes 

~DMfl  favorable  toward  adoption  of  pr-'  ect 
~DMa  committed  to  providing  nec  staff  and 

other  resources 
~DMa  receptive  to  co'^^nity  advice 

•  skills /knowledge 

~DMa  informed  regarding  choice  of  projects  (goals » 

features*  constraints) 
~DMa  aware  of  relevant  laws»  policies »  g  idelinee 

affecting  project 

•  rdes/lmage 

~DM's  key  personnel  for  adoption  work  identified 
and  in  a  position  to  do  work  necessary 

•  availability 

"administrators  wbo  are  in  a  position  to  make 
project-relevant  decisions^  are  available  for 
contacts  and  work 

Project  Director  (candidate  or  DM  in  PD  role) 

Processes 

•  select 

— DMs  identify  candidates 
— DMa  interview*  discusa  candidates 
~Board  of  Education  and  superintendent  approve 
candidate 

•  train/ inform 

— PD  reads  project  selection  materials  (ASK,  etc.) 
~PD  has  contacts  with  TRC,  other  consultants,  dif<" 

f users,  original  site  staff 
"PD  has  contacts  with  other  bilingual  projects 

(including  originating  lite) 
~PD  analyzes  availability  of  staff  and  other  re*- 

ticurcesf  informs  hlm/herself  about  policiec  and 

constraints  relevant  to  project  selection 

•  elicit 

—^superintendent  allots  funds  for  project 

— ^diffusers  and  original  site  staff  impress  PD  with 

importance  of  project 
-*ASK  motivates  enthusiasm  to  adopt  project 
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•  allocate 

~DM8  aaaign  rolea  and  responsibilities 


Outcomfes 
• 


goa Is /a  1 1 i  tudea 
~wllling  to  accept  role 
—ready  to  support  project 

akills/knovledge 

**aware  of  project  goala^  philoaophy^  featurea^  and 

structure 
—knows  role  he/ahe  will  play 

**aware  of  diatrict  mechaniama  (budgeting  procedures^ 

etc*}  and  hierarchy 
—aware  of  availability  of  staff  and  other  reaourcea^ 

and  about  policiea  and  conatra''nta  that  could  affect 

project 

roles /image 

**ia  in  a  poaition  appropriate  for  directing  project 
(seen  aa  having  atatua  equal  to  aimllar  level 
administrators) 

availability 

•^adequate  candidatea  are  available 


Potential  Prelect  Staff  (Teachers^  Aidea>  Instructional 
Coordinator) 

Proceaaea 

•  aelect/elicit 

»DH6  determine  intereat  in  project  and  asaeas  akilla 
(e*g*|  Are  there  enough  bilingual  teachera  with  appro* 
priate  akills  available  and  willing  to  join  project?) 

Outcomea 

•  goala/attitudea 

— ataff  candidatea  identified  have  appropriate  goals/ 
attitudea 

•  roles /image 

— ataff  candidatea  have  appropriate  rolea/image 

•  akilla /knowledge 

"Staff  candidatea  identified  have  appropriate  skilla 

•  ava  vility 

"autxicient  ataff  candidatea  in  each  category  are 
available  to  operate  project 
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Evalua tor 


Proceaaea 


•  aelecC 

— DMe  Identify  evaluator  with  adequate  baalc  knowl- 
edge and  apeclflc  knovledge  of  laauea  affecting 
bilingual  project  evaluation  (and  If  necea&ary, 
knowledge  of  training*  community  relations^  etc*} 

•  train/inform 

— Inform  evaluator  of  project  goals  and  features* 
special  needs  of  bilingual  project^  and  If  necea** 
aary,  arrange  for  training  In  bilingual  project 
evaluation  laauea  (prepare  to  select  tests  with 
appropriate  regional  vocabulary;  distinguish  lan- 
guage proficiency  from  dominance;  test  reading  knowl* 
edge  In  both  Isnguages) 

•  elicit 

—funding  agencies  make  clear  their  criteria  for 
adequate  evaluation  r^orts  and  sanctions  for  not 
delivering  them 

•  allocate 

— DMb  clearly  assign  job  of  designing  evaluation  to 
evaluator 

Outcomes 

•  goals/attitudes 

—evaluator  wants  to  prepare  a  sound  evaluation  report 

•  ski  Ha/knowledge 

—evaluator  knovs  how  to  prepare  a  aound  evaluation 
design  for  a  bilingual  project 

•  roles /image 

— evaluator's  role  Is  clear  to  district  officials 
and  staff 

•  availability 

—evaluator  has  time  to  allot  to  project 

Regular  School  Personnel 
Processea 

•  aelcct 

— PD  determines  relevant  staff  to  Inform  about  the 
proj ect 
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•  train/inform 

~PD  holds  orientation  meetings  or  otherwise  briefs 
staff  members 

•  elicit 

~PD  Impresses  staff  with  importance  of  project* 
how  it  will  help  staff  with  duties*  etc* 

Outcomes 

•  goals /attitudes 

"Staff  accepts /supports  project  installation 

•  skills/knowledge 

—staff  aware  of  project  before  it  is  installed 

Community  and  Parents 
Processes 

•  select 

— DHs  identify  key  individuals  or  groups  in  the 
community 

•  train/inform 

—project  advocates  explain  project  philosophy  (e*g* 
purpose  of  native  language  literacy*  of  early 
learning  throug^h  dominant  language)  to  community 
members 

—project  advocates  inform  community  members  about 
project  options  (through  public  meeting*  announce- 
ment in  paper*  on  radio) 

"*^M8  inform  community  of  federal  requirements  for 
parent  involvement 

••^^-commcnity  groups  hold  meetings*  sponsor  media 
announcments  *  telephone  to  inform  community  about 
need  for  project 

•  elicit 

—DHs  elicit  community  opinion  about  choice  of  proj- 
ects 

— community  organizations  (e*g**  La  Raza  Association) 
arouse  anger  of  community 

A  allocate 

^community  and  parents  form  themselves  or  others 

into  pressure  groups*  task  forces*  etc* 

—DMs  form  parent  group  to  approve  proposal 
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3  goals/attitudes 

^community  is  supportive  of  project 
—community  members  have  goals  reflecting  local 

conditions  (replace  school  board  member*  start 

adult  education  program) 

•  skills /knowledge 

— comimtnity  is  informed  about  project  and  its 

philosophy*  goals  and  methods 
— ccnmminity  has  new  organizational  skills 

•  roles /image 

—community  members  see  themselves  as  active  in 

school  affairs 
— OMs  see  community  as  active  in  school  affairs 

•  availability 

—community  taembers  available  to  participate  in 
planning  and  to  approve  project  plans  and  proposal 

Start-up 

a*    Decision  Makers 
Processes 

•  select 

— PO  determines  relevant  I>Ms  to  contact 

«    train/ inf  orm 

— PO  informs  OMs  about  project  goals*  procedures* 
philosophy*  structure  etc^*  as  they  relate  to 
JM  roles  (PO  uses  board  meeting  reports*  evalua- 
tion plans*  etcO 

—1Mb  and  PD  inquire  about  laws  and  guidelines 

relevant  to  project;  determine  compliance  require- 
ments 

•  elicit 

—ED  elicits  0M  support  for  project  start-up 

•  allocate 

— allocate  time  for  considering  decisions  re- 
lated to  project 


561 

525 


Outcomes 


•  goals /attitudes 

-^DMs  sufficiently  action-oriented  to  promote 
efficient  project  start-up  (no  blocks  to  pur- 
chasing)  hiring»  budget  adjustments) 

•  skills /knowledge 

-*DMs  ausre  of  project  goals»  procedures*  etc.» 
insofar  as  project  depends  on  DM  support  for 
start-up 

•  roles /linage 

""Shifts  of  power  or  authority  within  district 

(due  to  project  grant  or  role  assignments)  facili- 
tate start-up 

•  availability 

~DMs  available  for  contact  (to  grant  permission» 
consult,  meet  with  PD) 

Project  Directors 

Processes 

•  select 

-^DMs  assign  position  definitely  (or  hire)  PD 

•  train/ inform 

-^PD  reads  PIP  and  seeks  technical  assistance 

necessary  to  train  him  or  herself 
-^PD  informs  self  about  cultural*  social  and 

language  issues  relevant  to  the  project  and  the 

coffluiunity 
~PD  reviews  curriculum  materials 
-^PD  familiarizes  him  or  herself  with  district 

procedures  and  structure 

•  elicit 

— DM3»  diffusers»  0£  make  job  assignment  clear 
and  provide  incentives  for  PD  to  carry  out  his/ 
her  role  well 

— PD  establishes  role  by  performing  key  functions 
(staff  selection,  budget  control) 

"PD  reads  PIP;  PIP  encourages  desire  to  replicate 

•  allocate 

— PD  organizes  ti:te  to  study  project  and  start  it 

effectively 
»DM8  assign  PD  role  in  time  for  start-up 
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Outcomea 


•  goals/attitudes 

— cofflnltment  to  project  i&  well-formed 

•  skills /knowledge 

~adaini8trative  (ntanagementt  public  relations^  etc.) 

skills  sufficient  for  start'^up 
-^knowledge  of  laws»  policies  and  guidelines  affect* 

ing  project  is  sufficient 
—has  knowledge  of  project  and  school  roles  and  functions 
—has  knovle^lge  of  DM  functions  (who  to  keep  infoniied» 

who  to  contact  for  permissions) 

•  roles /image 

—position  as  PD  established  in  district 

•  availability 

—sufficient  time  available  for  responsibilities 

Project  Staff 
Processes 

•  select 

~DHs  and  PD  establish  criteria  for  staff  selection 
— PD  identifies  local  talent  and  advertises  positions 
— PD  screens  applicants  with  appropriate  panel 
— PD  hires  or  selects  staff  members  for  each  position 

(teacher^  aide»  instructional  coordinator*  etc.) 

based  on  competencies »  not  tenure 

•  train/inform 

~PD  informs  potential  staff  members  about  project 
—staff  members  attend  workshop  sponsored  by  the 
project 

—staff  members  receive  training  as  necessary  in 
language  skills »  evaluation*  duties »  bilingual 
teaching  methods 

— PD  assures  that  teachers  are  aware  of  school 

procedures  during  recess,  in  library  and  cafeteria* 
etc.»  and  can  coordinate  with  other  special 
projects 

•  elicit 

— PD  elicits  agreement  to  join  project  (offers 
suitable  salary »  career  ladder*  good  working  con- 
ditions, etc. } 
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~P&  elicits  support  for  project  (comntitment  neces- 
sary for  effectively  playing  designated  role  and 
having  loyalty  to  project) 

~P&  encourages  participation  in  decision  making 

allocate 

~P&  assigns  roles 


goals/ attitudes 

"Committed  to  project  and  participation  (volun- 
teered) 

—committed  to  bilingual  education 
skills /knowledge 

—^sufficient  language  skills  (Spanish/ French/English) 
to  fulfill  role  in  project 

^  bilingual  (speaks  and  understands  English  and 
standard  French  or  Spanish) 

-  speaks  and  understands  local  varieties  of 
children's  home  language 

-  has  some  degree  of  fluency  in  children's  home 
language  (native  speaker;  uses  Spanish/ French 
at  honte  with  family  and  friends) 

— sufficien^t  knowledge  of  bilingual  education 
methods  and  materials 

—sufficient  knowledge  of  district  and  school  pro- 
cedures to  perform  functions  in  project  (aware  of 
political  and  social  climate  and  practical  proce- 
dures; aware  of  pressure  groups »  etc.) 

-^sufficient  knowledge  of  community  and  home  culture 
to  perform  functions  in  project 

— ^sufficient  knowledge  of  project  and  roles  to  teach 
effectively  (according  to  FIF  guidelines) 

roles /image 

-^ct:edible  as  bilingual  staff  (previous  college  and 
inservice  training*  credential*  certification) 

— 'Staff  roles  are  set  appropriately  (e.g.,  who  re- 
ports to  whom;  staff-school  relations  good; 
teachers  participate  in  decision-making) 

~role  is  appropirate  in  relation  to  regular  staff 

availability 

— sufficient  number  of  staff  members  assigned  to 
each  position  (bilingual  aides,  curriculum  spe- 
cialists, etc.) 

— selected  in  time  for  training 


Outcomes 
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Regular  School  Personnel 


Processes 

•  select 

— PD  Identifies  key  regular  school  personnel  (who 
are  Influential  or  potentially  troublesome) 

•  trsln/lnform 

~PD  or  project  staff  Informs  regular  staff  about 
project  and  Its  relation  to  them 

•  elicit 

~PD  seeks  to  Interest  regular  staff  In  the  project 
Outcomes 

•  goals/sttltudes 

—accept  and  support  project 

•  skills/knowledge 

~aufflclent  knowledge  of  project  to  answer  parent 
questions  and  to  satisfy  professional  Interest 

•  rolea/lroage 

—relationship  established  between  PD  and  prlnclpsl^ 
between  project  staff  and  regular  school  staff 

•  availability 

~staff  Is  available  for.  orientations^  contacts 

Community  and  Parents 
Processes 

•  select 

~PD  continues  to  Identify  key  Individuals  and 

groups  from  community 
—community  members  volunteer  (or  PD  recruits  them) 

to  be  members  of  the  Community  Advisory  Committee 

(CAC)  and  to  be  parent  aides 

•  train /inform 

-*PD  (or  principal)  Informs  community  members^ 

groups^  and  parents  about  project  (all  LES  parents) 

•  elicit 

— PD  elicits  support  for  project  (permission  to 
send  students  I  Volunteer  for  PAC^  to  be  an  aide) 


565 


Outcomes 


•  goals/attitudes 

— support  project  and  Its  goals 

—parents  choose  to  have  students  participate 

•  skills/knowledge 

~know  about  federal  law  requiring  parent  input 
~aware  of  project  and  understand  its  philosophy^ 
goals  and  methods 

•  roles /image 

^^arents  see  themselves  as  involved/active/powerful 

•  availability 

~8vailable  for  contacts  or  meetings 


Operation 

a*    Decision  Makers 
Processes 

•  train/ inform 

»PD  and  project  staff  attend  board  meetings^  submit 
reports  I  and  inform  decision  makers  informally 
about  project  events  and  progress 

—Evaluator  and  PD  present  and  explain  evaluation 
results  when  available 

•  elicit 

— PD  seeks  to  create*  increase  and/or  maintain 
positive  attitudes  sufficiently  to  guarantee 
project  continuation 

Outcomes 

•  goals/attitudes 

—support  project  sufficiently  to  ensure  efficient 
project  operation 

•  skills /knowledge 

~aware  of  project  problems  and  events  that  require 
DM  action 

•  roles/image 

~DM's  roles  change  as  necessary  during  project 

operation  (by  delegating  or  assuming  responsibility) 

•  availability 

~DMs  svailable  for  contacts  as  needed 
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Project  Director 
Proceaaea 

•  train/inform 

»PD  leama  more  about  hia/her  function  by  perfonalng 
It 

~PD  attenda  training  aeaaiona,  conventiona,  etc* 

•  elicit 

"Federal  Projects  officer  elicita  compliance  with 
guidelinea;  effective  action  etc* 

•  allocate 

~PDa  allocate  time  aufficlent  to  perform  functiona 
Outcomea 

•  goala/attitudes 

—continued  commitment  to  project 

•  akil la /knowledge 

—admlniatrative  akilla  aufficient  for  operation 

•  rolea/image 

—poaition  aa  PD  ia  establiahed  (va*  t^porary  or  token 
^oaition)  and  maintained  (recognized  aa  leader) 

•  availability 

— PD  allocatea  time  to  perform  functiona 

Prol&ct  Staff 
Proceaaea 

•  aelect 

— PD  aelecta  x^ew  ataff  for  replacementa  and  expanaion 

•  train/inform 

»PD  arrangea  for  inaervice  training  aa  needed 
(consultanta,  conventional  etc*) 

•  elicit 

»PD  aeeka  aupport  of  ataff  for  project 

~PD  offera  appropriate  incentivea  for  good  ataff  to 

remain  (aalary^  working  conditional  etc*) 
— PD  and  ataff  maintain  good  communication  with  each 

other 

•  allocate 

-*^ataff  allocatea  time  needed  to  perform  £unctiona  (pre* 

paration  time  for  teachings  meeting  attendance^  ^atc*) 
—ataff  plana  jointly  aa  needed 
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Outcomes 


•  goals/attitudes 

"positive  attitudes  toward  all  students  (LES,  HES, 

FES)  and  instructors 
"Continued  commitment  to  project  and  bilingual 

education 

"Continued  acceptance  of  students'  home  culture 
—accepts  role  of  each  project  staff  member 
^attitudes  towards  children's  parents 
"loyalty  among  staff  toward  principal,  project,  and 
director 

•  skills/knowledge 

—adequate  skill  to  function  effectively  in  project 
"knowledge  of  roles  of  all  staff  members  (project 

teachers  clearly  understand  roles  of  support 

staff) 

•  roles /image 

— continued  credibility  as  bilingual  staff 
"FD,  school  staff  and  DM's  recognize  bilingual 

project  staff  roles  (scope  of  duties) 
"bilingual  aide's  role/function  accepted 
^-minority  instructor  serves  as  role  model 

•  availability 

"time  allotment  appropriate  to  duties 
"Sufficient  number  of  staff  members  r^nain  avail* 
able  throughout  the  school  year 

Regular  School  Staff 

Processes 

•  train/inform 

"PD  or  project  staff  informs  regular  staff  about 
project  and  its  relation  to  them 

•  elicit 

»PD  or  project  staff  seeks  interest  in  the  project 
by  regular  staff  (by  joint  planning,  joint  projects) 

Outcomes 

•  goals/attitudes 

"accept  and  support  project 

•  skills /knowledge 

"Sufficient  knowledge  of  project  to  answer  parent 
questions 
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•  availability 

— project  staff  is  available  for  orientations » 
contacts »  joint  planning 

e*    Community  and  Parents 

Processes 

•  select 

— PD  or  project  staff  identify  key  individuals  or 
grou^A  in  the  community 

9  train/inform 

— PD>  project  staff*  principal,  and  evaluator  inform 
community  members  about  project  (letters,  newslet*- 
ters,  meetings,  radio,  TV,  telephone,  home  visits, 
festive  events,  notices,  evaluation  reports) 

•  elicit 

»PD  or  project  staff  elicits  parent  support  for 
project 

Outcomes 

•  goals/attitudes 

— support  project  and  its  goals  (volunteer  for  Parent 
Advisory  Council,  serve  as  aide,  willing  to  send 
students) 

•  skills/knowledge 
— aware  of  project 

•  availability 

—sufficient  number  of  parents  and  community  members 
are  available  for  contacts  or  meetings 

Other  Resources 

1*    I  itial  Conditions 

a*    Materials /Equipment 

•  adequate  basic  curriculum  materials  in  English  and 
non*-£nglish  language  (district  or  state  mandated,  etc*) 
are  available 

•  &cadent  records  are  available  as  needed 

b*  Facilities 

•  Administrative  offices 

—equipped  as  needed  (typewriter,  supplies) 
— space  available  to  allocate  for  project  (no 
severe  overcrowding,  ,well  located) 


569 

533 


•    school  and  classrooms  (and  Parent  Involvement  Center) 
«rooms  meet  health  and  safety  standards  (sufficient 

size*  quiet*  light*  ventilation*  heat*  access) 
"location  is  adequate  (in  relation  to  community 

residency  patterns*  bussing*  desegregation) 
"design  is  appropriate  (walls  present  or  absent* 

etc*) 

"sufficient  number  of  classrooms 
c*  Funds 

— d?^trict  operates  with  sufficient  funds  to  avoid 

ndsappropriation  of  project  funds  (or  delay  of 

allocation  of  project  funds) 
"Sufficient  funding  sources  are    available  to 

support  the  project  (ESEA  Title  VII*  state  bi-^ 

lingual  funds*  etc*) 
"DMe  and  community  approve  use  of  funds  for  bilin- 

lingual  education 


Preparation  for  Diffusion 
a*  Meterials/EquiPment 

•  aelect 

"OE  (or  contractor)  identifies  exlating  packages 
available  for  diffusion  of  projects  (analyzes  their 
usefulness*  etc* ) 

•  U^velop /modify 

"OE  and/or  technical  consultants  select  projects 
(identify  candidate  projcts*  set  criteria  for 
selection*  apply  criteria  including  validation  by 
JBRF*  make  final  selection*  consider  market  for 
projects  to  adop' ^ 

"OE  and/or  technical  consultants  with  developer 
site  staff 

-  develop  sets  of  specification  for  packaged 
projects  (consider  delivery  system*  needs  of 
potential  adoptors*  and  project  features) 

-  produce  packages  appropriate  for  project  diffu-^ 


Outcomes 

•    content /appearance 

^adequate  printed  and  audiovisual  materials  are 
available  for  LEAs  to  adopt  new  projecta 
^  content  complete  and  accurate 
-  format  useable*  appealing 


sion 
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•  roles/image 

— ^packages  acceptable  to  users 

ethnic  and  linguistic  presentation  in  displays 
and  audiovisual  materials 
-  cosi_  not  prohibitive 
—packages  acceptable  to  developer  site  staff  (con- 
sideiced  a  useable  and  accurate  presenta'^lon  of 
their  project) 

•  availability 

"Sufficient  number  of  copies  of  packages  or  components 
available  for  each  user  (teachers*  principals*  etc«) 

Adopt ion/ Select ion 
a*  Materials/Equipment 
Processes 

•  select 

~DHs  assess  curriculum  materials  in  the  schools  to 
determine  how  many  materials  need  to  be  ordered 

*^DHs  determine  sources  of  bilingual  materials 
'e«g«|  site-produced  booklets) 

•  develop/modify 

~DHs  prepare  proposal  for  project*  following 
requirements  for  format  and  meeting  deadline 

Outcomes 

•  adequate  bilingual  materials  are  commercially 
available  or  can  be  developed 

4    proposal  is  available  to  funding  agency  on  time 
(with  adequate  content  and  appearance) 

bn  Facilities 

1)  Administrative  offices 

Processes 

•  select 

— I:ds  tentatively  choose  office  space  for  PD> 
e\^iuator»  instructional  consultant*  community 
coordinator  (if  necessary) 

•  develop/modify 

—DHs  plan  changes  needed  for  PI*  office 
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•  allocate 

—DMs  tentatively  assign  FD  (and  others)  an  office 
Outcomes 

•  adequate  administrative  offices  available  (compar- 
able to  other  district  offices) 

2)  Adequate  schools  and  classrooms  (and  Parent  Involve* 
ment  Center)  available 

Processes 

•  select 

— DMs  identify  schools  or  classrooms  for  project 
use  (considering  staff  and  parent  wishes) 

•  develop /modif' 

—DMs  plan  cc    "ruction  needed*  if  any 
—DMs  plan  il  ^  lications  needed  to  meet  health  and 
safety  reguX.  ^ions 

•  allocate 

—DMs  assign  schools  or  classrooms  for  project 
(consulting  with  principal  and  staff) 

Outcomes 

•  adequate  classrooms  (and  Parent  Involvement  Center) 
available  (comparable  to  other  district  classrooms 
and  centers;  e.g.»  well  located;  meet  health  and 
safety  regulations  and  design  requirements  of 
project) 

Funds 

Processes 

•  select 

—DMs  identify  funding  sources  for  bilingual 
education*  write  proposals  to  seek  funds 

•  allocate 

»DMs  prepare  budgets  to  accomodate  project  and  as 
required  by  funding  agency 

Outcomes 

•  funding  level  is  sufficient  for  project 

•  budget  categories  afford  efficient  operation  of 
project 


start-up 


a.    Materials /Equipment 
Proces ses 

•  select 

— PD  and  staff  review  and  analyze  appropriateness  of 

various  bilingual  materials 
'^'PD  and  staff  select  and  order  materia?:,  and 

equipment  needed  (e*g*,  core  and  supplementary 

materlala  specified  In  PIP) 
— PD  and  staff  seek  Information  (e*g*,  from  PD  and 

other  sites)  regarding  sources  of  bilingual 

materials 

^Evaluator  selects  and  orders  tests 

•  develop /mo  dlf y 

~PD  and  staff  develop  bilingual  materials  as 
necessary 

•  allocate 

»PD  distributes  materials  and  equipment  to  class- 
rooms 

-^teachers  (and  aides)  arrange  materials  and  equip- 
njent  In  classroom  (e*g*|  set  up  learning  centers) 

Outcomes 

•  content  of  bilingual  curriculum  materials 
-^language  features  of  printed  materials  are  appro-- 

prlate 

-  regional  variety 

*  standard/non'^standard  language 

-  vocabulary 

—difficulty  level  (vocabulary)  of  materials  is 

correct  for  students'  ability 
^topics  are  appropriate  for  age  of  students  and 

relevant  to  their  experience  (regional  content) 
—materials  are  of  high  quality  (of  clear,  wide 

scope,  sequentially  arranged  with  skills  Identl* 

fled,  meet  objectives  specified  for  project  and 

district) 

•  appearance  of  bilingual  curriculum  materials 
— Illustrations  are  appropriate 

^packaging  adequate  (equivalent  to  English  materials) 
'-  quality  of  paper 

-  format 

-  graphics 
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•  roles/image 

****sta££,  DH8»  PD,  community  and  parents  Judge 
materials  suitable  for  local  students 

•  availability 

—bilingual  materials^  commercial  or  locally  devel*- 

oped,  are  available 
****equipment  and  supplies  are  available 

Facilities 

1)  Administrative  Offices 
Processes 

•  select 

»DHs  make  final  selection  of  office 

•  develop /modify 

**<*DHs  carry  out  changes  needed  in  office 

•  allocate 

~DHs  make  final  office  assignment 

Outcomes 

•  PD  has  adequate  office  (well  located)  available 
for  use  at  beginning  of  startup 

2)  Classrooms  (and  Parent  Involvement  Centers) 
Processes 

•  select 

— PD  works  with  principals  in  assignment  of  class- 
rooms (and  Parent  Involvement  Center)  for  project 

•  develop/modify 

*-PD  assures  that  changes  needed,  e*g*  construction 
and  safety  modifications  are  carried  out 

^teachers  decorate  rooms  according  to  PIP  guide- 
lines (e*g*  bilingual  displays) 

•  allocate 

— principals  assign  project  classrooms 
— teachers  (and  aides)  arrange  furniture  as  needed 
for  project  e*g*  open  classroom  arr4ngements 

Outcomes 

•  project  classrooms  (and  Parent  InVolVanent  Center) 
adequate  and  available 
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c*  Funds 


Process es 

•  select 

— PD  st^eks  continuation  funding  sources  and  complies 
with  funding  agency  guidelines  tc  assure  continued 
support 

•  allocate 

•*^PD  spends  funds  according  to  budget  (modifying  as 
needed) 

Outcomes 

-*^suff icient  funding  is  available  in  all  budget  cate^ 
gories 

5^  Operation 

a*    Mate rials /Equipment 

Processes 

•  select 

~PD  and/or  staff  review  and  select  new  msterials 
and  equipment  as  needed*  e^g^  for  second  year,  for 
students  needs  as  identified 

•  develop/modify 

— staff  (^*&*  curriculum  coordinater)  develops  and 
modifies  materials  as  needed 

•  allocate 

"BMs  and  PB  distribute  materials  as  they  arrive 
~staff  members  arrange  materials  for  efficient  use 

(e^g^  sharing  among  teams;  storage  and  display 

within  classrooms) 

Outcomes 

•  adequate  materials  (as  defined  in  stan:-up)  retnain 
available  and  acceptable*  or  new  ones  have  been 
secured 

b*    Facilities  ClassroomB 

Processes 

•  develop/modify 

^teachers  decorate  room  as  specified  in  PIP  (e^g^ 
dispi«iys  in  two  languages,  bright,  colorful*  etc^) 
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Outcomes 


•  adequate  classrooms  are  In  use 
~bilingual/bicultural  displays  (appropriate  themes) 
—displays  of  student  work 

c*  Funds 

Processes 

•  select 

— PD  seeks  continuation  funding  sources  and  compiles 
with  funding  agency  guidelines  to  assure  continued 
support 

•  allocate 

— PD  spends  funds  according  to  budget  (modifying  as 
needed) 

Outcomes 

—sufficient  funding  is  available  in  all  budget  cate- 
gories 

Project  Plans  and  Constraints 
1*    Initial  Conditions 
a*    Pro;1ect  Plans 

•  suitable  projects  available  (JDRP  approvablej 
relevant  to  student  needs) 

•  district  has  long-range  plan  for  languages  (transi- 
tion) maintenance) 

b*    Cons traints  (laws»  policies»  guidelines) 

•  content 

— explicit  and  clear  federal*  State  and  local  laws 
and  guidelines  about  bilingual  education  and 
special  projects  (funding  requirements) 

— Implicit  policies  (local»  regional*  or  national) 
affecting  bilingual  education  and  special  projects 
(e*g*»  allowing  bilingual  volunteers)  are  clear 

—specific  conditions  of  funding  agencies  clear 

—teachers'  union  and  contract  agreanents  clear 

Q    roles/image  (degree  of  compliance/enforcement) 

— sanctiona  for  enforcing  laws  and  policies  are  clear 
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•  availsbility 

— Infomstion  regsrding  laws»  guidelines»  and 

policies  available  to  schools 
~£ormal  lawa^  guidelines^  policies  are  available  in 

usable  form  (non*technical  language*  limited 

detail)  sufficient  brevity*  explicit  statements) 
— in^licit  constraints  or  informal  policies  are  made 

clear  to  users 

Se  le  c  t  ion/Adop  t  ion 
a*    Project  Plans 
Processes 

•  Wa  make  necessary  project  plans 
Outcomes 

•  tentative  plans  are  made  for  project  adoption^ 
start-upi  operation^  and  continuation 

b*    Constraints  (laws,  policies,  guidelines) 

Processes 

•  develop /modify 

-^Ms  formulate  policies  suitable  for  project 

(e^g^,  arrange  for  hiring  bilingual  teachers  even 
if  there  is  no  vacancy) 

»DHs  modify  local  policies  ss  necessary  for 
project 

«DMs  make  policies  and  sanctions  known  to  school 
and  community  (seek  parental  views) 

Outcomes 

•  content 

— district  has  policies  favorable  to  project 
»DHs  are  aware  of  laws  and  guidelines  relevant  to 
project 

— project  guidelines  compatible  with  district  policy 
(practical,  realistic) 

•  roles/Image  (degree  of  compliance/enforcement) 

— schools  continue  to  comply  with  laws,  policies  and 
guidelines 

~law3  and  guidelines  are  enforced  and  constraints 
made  operational 
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•  availability 

-^information  regarding  formal  lavs^  guidelines »  and 

policies  available  to  schools 
»law8»  guidelines »  policies  are  available  in  usable 

form  (non*technical  language^  limited  detail^ 

sufficient  brevity^  explicit  statements) 
"implicit  constraints  or  informal  policies  are  made 

clear  to  uaers 

Start^Up 

a*    Project  Plans 
Processes 

•  DMs  and  PD  adopt  and  revise  plans  for  project 
—^valuator  plans  sound  evaluation  suitable  for 

bilingual  project  (assesses  language  acquisition » 
culture^  readings  math»  affective  gains »  other 
subjects;  gathers  data  on  students'  home  language^ 
SRSt  mobility) 

"PD  plans  training  sessions »  facilities  use»  etc. 

—staff  and  evaluator  plan  for  curriculum  continuity 
(behavioral  objectivea  and  tests  for  each  grade 
level) 

Outcomes 

•  detailed  project  plans  are  made  for  &tart*^up» 
operation  and  continuation 

b.  Constraints 

Processes 

•  develop /modify 

»I)M8  formulata  or  modify  policies  suitable  for 
project 

•  allocate 

—DMs  inquire  about  lavs  and  guidelines  relevant  to 
projects »  determine  compliance  requirements 

—policy  makers  or  legislatora  disaeminate  lavs  and 
policies 

Outcomes 

•  content 

— district  has  policies  favorable  to  project 
— PD  disseminates  laws  and  gaidelines  relevant  to 
project 
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•  roles/image  (degree  of  compliance/enforcement) 
—BchoolB  continue  to  comply  with  lawB»  policies  and 

guidelines 

~laws  and  guidelines  are  enforced  by  relevant  agency 

•  availability 

-"information  regarding  laws,  guidelines »  and 

policies  available  to  schools 
<**laws»  guidelines!  policies  are  available  in  usable 

form  (non^technical  language^  limited  detail^ 

sufficient  brevity^  explicit  statements) 
—implicit  constraints  or  informal  policies  are  made 

clear  and  usable 


Operation 

Project  Plans 
Processes 

•  staff  and  evaluator  nlan  for  curriculum  continuity 
(behavioral  object        and  tests  for  each  grade 
level) 

•  DMs  revise  plans  as  needed  and  formulate  plans  for 
continuation 

Outcomes 

•  PD  and  DMs  prepare  proposals  and  plans  for  continu* 
ation 

b*  Constraints 

Processes 

•  develop/modify 

—DMs  formulate  policies  suitable  for  project 
—DMs  make  plans  necessary  for  project 
—DMs  modify  local  policies  as  necessary  for 
project 

»PD  works  toward  policy  changea  aa  it  seems  feas^ 

ible  and  wise 
—DMs  make  policies  and  sanctions  known 

Outcomes 

•  content 

—district  has  policies  favorable  to  project 
~DMs  are  aware  of  laws  and  guidelines  relevant  to 
project 
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•  roles 'ii&dge  (degree  of  compliance/enforcement) 
*^schools  continue  to  comply  with  laws»  policies  and 

guidelines 

~laws  and  guidelines  are  enforced  (and  enforcable) 
— laws  and  guidelines  are  seen  as  reasonable 

•  availability 

— information  regarding  laws»  guidelines »  and 

policies  available  to  schools 
— laws»  guidelines »  policies  are  available  in  usable 

form  (non- technical  language*  limited  detail* 

sufficient  brevity*  explicit  statements) 
— implicit  constraints  or  informal  policies  are  utade 

clear  and  usable 


Students 

1*    Initial  Conditions 

•  goals  and  attitudes 

— level  of  achievement  motivation  (vandalism*  absen*^ 
teeism*  drop-out  rate*  retentions)  in  reasonable  range 

— positive  attitudes  towards  bilingual  programs  and 
school 

—positive  attitudes  towards  use  of  first  and  second 

languages 
—good  self-concept 

•  skills /knowledge 

—proficiency  in  languages  spoken  at  home  and  school 

in  reasonable  range 
*-*level  of  general  skills  suitable  for  age  (may  relate 

to  time  in  U*S*  and  U*S*  schools*  previous  bilingual 

program) 
—language  dominance 

— ability  in  academic  subjects  in  reasonable  range 

•  roles/image  (as  seen  by  teachers*  administrators* 
community) 

— ethnicity  (numbers*  %) 

—autonomy*  activ'.ty  (vs*  dependence*  passivity)  in 
learning  situation 

•  availability 
—attendance  levels  high 

— appropriate  number  of  students  with  need  for  special 

project  (in  relation  to  total  school  population) 
™migrancy*  transiency  law 


2*    Select ion/Adoption 


Proceaaea 


•  aelect 


~DMs  identify  target  atudenta  by  achool  and  general 
character iatica  (needa)  and  coonnunicate  with  parenta» 
principala»  and  evaluator 

— DHa  enaure  that  a  aufficient  number  of  atudenta  need 
project 


•    tentative  target  group  with  appropriate  characteriatica 
(LES»  MS)  ia  identified 


Proceaaea 

•  aelect 

~evaluator»  PD»  and  ataff  formulate  atudent  entry  cri- 
teria (and  exit  criteria*  if  deaired) 

-  achievement  level  (including  reading  readinesa) 

-  language  dominance  and  proficiency 

-  ethnicity 
aocioeconomic  atatus  (SES) 

-  volunteera  for  participation 
deaegregation  quotaa 

-  teacher  nomination 

-  compatibility  with  other  atudenta  or  with  teacher 
^  availability  of  inatructora»  materiala»  and 

facilitiea 

-  parental  wiah 

-  age 

-  attendance  pattern 

-  language  expoaure  outaide  achool 
~teachera  identify  apeclfic  children  (by  deter- 
mining their  needa)  and  wants)  to  participate 
in  project  (aecure  parental  permiaaion»  teat» 
get  nominationa) 

~evaluator  asaiata  ataff  in  planning  aaaeasment 
needed 

—parents  enroll  their  children  in  project 

•  allocate  (organize/aaaign) 

ataff»  and  evaluator  asaign  atudenta  to  groups 
or  claaarooma  (whole  claaaes»  pull-out»  groupa  within 
claaaea»  aegregation  or  relocation  of  LES/NES  atudenta) 
~PD  determinea  criteria  for  atudent  placement  (aame  aa 
entry  and  exit  criteris»  ibove»  plua  akill  of  teachera 
and  aides) 


Out cornea 


3*  Start-up 
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~PD  and  evaluator  determine  procedures  and  times  for 
placement,  re*^grouplng  (If  any)  and  exit  (If  sny) 
^  testing 

^  teacher  evaluation 

^  parental  wl?h  ^nd  permission 

*  arbitrary 


Outcomes 


appropriate  children  (goals/attitudes,  skills/knowledge 
aptitude,  Imsge)  In  sufficient  numbers  are  assigned  to 
each  group  or  classroom* 


Operation 

Processes 

•  select 

~teachers  screen  new  students  for  entry  into  the 
project 

~teachers  determine  when  students  should  leave  project 
using  exit  criteria  (maximum  grade  level  achieved, 
parental  request,  state  law,  skills  adequate) 

•  train /info 
— content 

^  instructors  present  planned  content  (teach 
appL'opriste  subjects,  cover  topics  in  syllabus 
and  in  lists  of  performance  objectives,  English 
and  second  language  skill  development  comparable}* 

^  instructors  vary  content  according  to  students' 
needs  (regional  variation  in  culture  and  language, 
individual  differences,  specific  behavioral 
objectives) 

^  instructors  teach  language  and  culture  well 
(cultural  material  integrated  across  subjects, 
children's  language  taught  with  culture,  realistic 
(vs*  touristic)  approach  to  culture 

instructors  and  evaluator  determine  content  areas 
students  know 

**select  or  develop  tests  appropriate  for  bi*" 

lingual  students 
**adininister  diagnostic  and  achievement  tests 

<"  ''nstructors  and  evaluator  keep  records  of  student 
ftrogress  and  achievement 

**student  and  class  profiles  (checklists  of  skills, 
contracts,  affective  growth  charts,  student 
record  folders)  . 
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—method 

*-  instructors  use  special  approaches  (If  any)  well 

*  ^computer  sssisted 
**programmed  tutoring 

instructors  use  regular  techniques  well 

**question  and  answer*  discussion 

* .worksheets,  seatwork 

ttgames,  songs,  field  trips,  projects 

t*felt  board,  pictures,  displays 

*  *stories,  explsnations 
* *programmed  materials 
**TV,  film,  audio^tape 
**Language  Master,  Systems  80 

^  instructors  use  bilingual  techniques  well  (follow 
plan  for  language  use) 

**language  use  in  instruction 

*  systematic  alternation  during  lesson  (back* 
to^back,  pr€iriew«r€view,  translation,  pattern 
drill) 

*  requirement  to  speak  or  write  first  or  second 
language  in  certain  subjects 

*  free  alternation 

**approach  to  non-standard  forms 

*  non^standsrd  forms  in  home  language  are 
accepted  or  corrected  (syntax  vs*  pronuncia^ 
tion;  during  formal  lesson  vs*  during  free 
speech) 

*  ESL 

^  Reading  and  other  language  sicills  in  native 
language 

*  method  of  correction  (correct  form  taught 
later,  corrected  Immediately) 

"  instructors  pace  instruction  well 
**students  work  at  own  pace 
** teachers  present  new  material  at  appropriate 

rate  (students  follow  and  ^re  not  bored) 
**rhythm  of  lesson  engsges  students'  interest 
* *high  percentage  of  time  in  actual  instruction 

or  prsctice  (V9*  orgsnizational  or  disciplinsry 

sctivities) 
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"  instructors  play  appropriate  roles  in  teschlng 

teacher  presents  nev  material;  if  monolingual^ 

does  English  instruction 
* *aide  has  instructional  role»  reinforces  con^ 

cepts^  or  does  home  langusge  instruction 
**parent  does  cultural  component^  clerical 

work»  tutoring^  reinforcing  native  language^ 

activities  and  special  events 
**instructors  follow  plan  for  percent  time 

bilingual  students  spend  with  teacher^  aide» 

and  other  staff  (compared  with  English-speaking 

students) 

**cross*age  and  peer  tutors  participate 
community  resource  person^  consul tant» 
specialists^  others  play  role 

•  el ici  t/mo  tivate 

—^instructors  use  planned  techniques  for  discipline^ 
noise  control^  and  reward/punishment 

—instructors  create  appropriate  affective  climate 
in  general 

-  self-concept  development 

-  teacher's  tone  of  voice,  empathy  enhance  learning 

-  teacher  provides  for  success  for  each  student 

—instructors  create  appropriate  affective  cl-fmate 
in  relation  to  language  and  culture 

-  instructors  show  acceptance  of  home  culture 
instructors  encourage/accept  responses  in  home 
language 

-  instructors  develop  positive  attitudes  in 
peers  toward  new  arrivals 

-  instructors  show  cultural  awareness  and  sensitivity 
(place  equal  value  on  both  languages  and  cultures) 

^  instructors  use  second  language  for  teaching  and 
at  other  times 

-  instructors  involve  parents  in  a  way  that  moti- 
vates students 

-  parents  help  form  positive  attitudes  (good  work 
habits) 

•  Allocate 

—teachers  schedule  students'  time 

-  bilingual  students  have  exposure  in  physical  edu- 
cation, art,  and  music  comparable  to  other  students 

-  t^ttvhers  group  and  regroup  students  within  their 
classes  (considering  student  and  parental  choice, 
test  results,  performance,  etc*) 

-  teachers  re-assign  students  as  needed  between 
clsss rooms 
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"  PD|  regular  staff  and  teachers  aEslgn  students 

to  classroomia  for  next  y^ar 
"  students  have  appropriate  time  with  various 

Instructors  (blllnguali  highly  skilled,  etc*) 

Outcomec 

•  goals/attitudes 

"Students  appreciate  having  their  parents  Involved  In 

school  activities 
"Students  perceive  bilingual  Instructor  as  role  model 
"Students  SLV*K  motivated  towards  using  English  and 

their  native  language  at  appropriate  times  during 

Instruction 
—students  have  good  f^elf-concept 
—students  appreciate  their  home  culture 
—students  want  to  communicate  with  and  associate  with 

students  from  other  ethnic  groups 
*^stu<!3ntB  have  positive  (or  less  neg^atlve)  attitudes 

coward  recent  arrivals 
"Students  like  school 

•  ski lis /knowledge 

— students  meet  skill  requirements  of  project  (English 
language,  home  language,  content  areas,  etc*) 

•  roles/image 

— students  ^re  accepted  by  their  peers  and  teachers 
"Students/  abilities  are  respected 

«  availability 

—students  who  need  the  project  continue  to  be  avail- 
able  to  participate  (proximity  to  school,  sufficient 
numbers  for  project  classrooms,  characteristics 
conform  to  policy,  e*g4,  segregation) 
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